Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Topics - RenatoPhoto

#1
Just a short lake video made with 5D3 + Samyang 14mm
First scenes with crop video 1:1 (3x zoom) and final two scenes (time=1.02) with 3x3 bining (no zoom).

#2


Yesterday I got a chance to test 10bit recording using crop module with 5D3 with firmware v.123
Lens 100-400 mm II
ISO between 200 and 3200.
First two scenes recorded at 60 fps at 1920x648 other shots recorded at 1920x1080 30 fps.
Hand held.
Magic Firmware: magiclantern-crop3x.2017Jan13.5D3123
Crop Rec download for testing here: https://builds.magiclantern.fm/experiments.html
#3
Share Your Videos / Rufous-bellied Seedsnipe
January 14, 2017, 01:24:05 AM


Sometimes as a bird guide I get close views of amazing birds.  This Seedsnipe a difficult bird to see and we were very lucky to to have such an encounter at close range (15 meters).  I took a quick video with my 5D3 with 100-400 mm II and the marvelous crop_mo which put me in 3X zoom HD mode as soon as I engaged the video button.
#4
Share Your Videos / Lunar Eclipse September 27 2015
October 09, 2015, 11:21:21 PM
Took some videos in raw during the lunar eclipse.  Mostly with fps between 1 and 15 fps to adjust for light conditions, iso between 100 and 6400.  Original video with cropped 3X zoom at 2880 x 1320 pixels.  Used raw histogram to monitor over exposure.  Also used dual iso in some videos but proffered to use raw video due to higher resolution.

Equipment used:
Canon 5D M3
Canon 100-400 II
Canon 1.4x Extender
Some takes with additional kenko 2x extender.

Tripod:
Old equatorial mount powered with a tiny 9v battery (http://www.bhphotovideo.com/c/product/546195-REG/Celestron_93514_Astromaster_Motor_Drive.html).  I was amazed that this motor could carry my camera and lens following the moon.

Music is computer generated using Cinescore; an old program from Sony.  Youtube claims that the music has copyright!

The Video:


Photos obtained from the video using AutoStakkert:


#5
Raw Video / New and Old Banding Issues
December 14, 2013, 03:02:58 PM
Here is a summary of the Banding issues that I could find.  Some Posts have been deleted but I was able to recover them using Google cached system.  I have provided the recovered post in zip files containing the html pages.

Any further Banding issues should be discussed here so I will lock the other post.

Weird vertical lines that fade away gradually
http://www.magiclantern.fm/forum/index.php?topic=8439.0
Sept 21

Vertical Lines: is it a recognized problem? Can it ruin the photography?
http://www.magiclantern.fm/forum/index.php?topic=8319.0
September 15

Banding issues
http://www.magiclantern.fm/forum/index.php?topic=7702.msg67345;topicseen#msg67345
August 16

Bad Banding
http://www.magiclantern.fm/forum/index.php?topic=6925.0
July 05

[SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording ...
Lost
Jun 2
Recovered Here: https://drive.google.com/file/d/0B9z8Y0rg-pu8c2RIeUpUNHdIMHc/edit?usp=sharing

[SOLVED] Vertical banding in raw Canon 5D mark III - Magic Lantern
LOST
May 23 2013
Recovered Here: https://drive.google.com/file/d/0B9z8Y0rg-pu8c3J6dzVZQmdUdnM/edit?usp=sharing

5D MK3 Raw sensor ISO noise samples
http://www.magiclantern.fm/forum/index.php?topic=5609.0
May 23
-------------------

Related Post:

PinkDotRemover tool 650D
http://www.magiclantern.fm/forum/index.php?topic=6658.0;topicseen
June 15

Aliasing correction in 60FPS RAW Video
http://www.magiclantern.fm/forum/index.php?topic=8044.0
Sept 2
#6
Share Your Videos / Machu Picchu June 21 Raw video test
November 12, 2013, 02:08:12 PM
One my first videos with ML RAW on 5D3
Lens Samyang 14 mm manual.
Card Lexar 1000X Pro 32 GB
Originally recorded at 1728x972 and 29 fps
Post processing ACR & Sony Vegas
Hand held amateur video



Any constructive criticism is welcome.  I still have a lot to learn!
#9
Feature Requests / Set Deflickering default to xmp
October 29, 2013, 12:45:48 PM
I dont think many people use UFR so can deflicker be set to XMP as default?
#10
Tragic Lantern / 5DIII Crash Erases Presets
October 28, 2013, 12:30:47 PM
I had a crash this weekend and erased all of my preset configurations and custom modules loaded. 
This was particular troublesome since I could no longer operate the camera in the mode I intended. 
Very frustrating experience because I did not have a copy of my customized ML and therefore the whole weekend I shot with many issues and problems.

ASSERT: IS_ERROR( Err ) == FALSE
at ./Multicast/PropertyMgr.c:50, task Evf
lv:1 mode:3


Magic Lantern version : Tragic.2013Oct25.5D3113
Mercurial changeset   : ce6ee58aed7a (unified) tip
Built on 2013-10-25 01:32:32 UTC by magiclantern@magiclantern-VirtualBox.
Free Memory  : 219K + 3711K
#11
The preview option is nice in raw_rec and would also be nice if a delete function is added.
This delete option is available in 1% builds and it is nice to replay and delete without having to move around the ML menu.
Of course there is file_man and that too is very nice.
#12
General Development / RAW Playback speed on 5D3
October 15, 2013, 10:41:19 PM
Would like to speedup playback of RAW video on 5D3. 
Any simple coding changes I can play with? 
As I recall CPU usage was around 85% but now CPU usage is removed so I cannot check.
#13
Feature Requests / Adjust RAW Exposure Measurement Area
October 14, 2013, 01:17:12 AM
The raw exposure calculations done by ETTR give erroneous numbers when using a Fisheye lens.  I have a 5D3 and an 8 mm fisheye which produce a circle image and a large black area around the image which ETTR is analyzing as if the black border was part of the image.  As a result the  Midtone SNR and the Shadow SNR will boost the exposure of the image above the required and correct levels.



Analyzing the image at the Canon crop of 3:2 5760x3840 we can inscribe a 3:2 rectangle inside the circle of 3170x2112

The crop factor would be 5760/3170 = 1.82

The same situation occurs with the fisheye and the 7D



Analyzing the image at the Canon crop of 3:2 5184x3456 we can inscribe a 3:2 rectangle inside the circle of 4506x3004

The crop factor would be 5184/4506 = 1.15

Also for my EFs 10-22 Canon on 5D3



Analyzing the image at the Canon crop of 3:2 5760x3840 we can inscribe a 3:2 rectangle inside the circle of 4062x

The crop factor would be 5760/4062 = 1.41

And yet another Tamron 17-50 on my 5D3



The crop factor would be 5760/3920 = 1.46

I assume that there will be other lenses so the option would be to have a user selectable crop factor or just pick some that could benefit all like:
1.2, 1.5, 2, 3

I put the 3 so that we could also measure the correct exposure for 5X cropped mode (equivalent to 3X crop factor).
#15
Feature Requests / Auto Dissable ETTR outside M mode
September 29, 2013, 09:23:21 PM
Dear Alex:

The functionality of ETTR outside M mode is not good.

In wildlife photography I use TV, C1, C2, C3 for very quick mode change to instantly adapt to the shooting requirements.
For example I program C3 for bird in flight, with shutter at 2000,  AI servo, High speed continuous shooting, 61 pt AF, Auto Iso, +3 EC.
C2 for bird against light, with shutter at 320, AI servo, High speed continuous shooting, AF Area Sorround, Auto Iso, +2 EC.
C1 for bird on the ground, with shutter at 250, AI servo, High speed continuous shooting, AF Spot, Auto Iso, +1 EC (kind-of ETTR).

I use these setting for quickly getting the photo without delays (Auto-power OFF=Disable).

When I have a little more time (the bird is posing for me) then I switch to M and optimize the light situation with ETTR and take a few more pictures.  Then I switch to RAW Video and get the most amazing 5X Cropped video of the birds.

Since ETTR cannot work quickly (instantly) in Tv mode (I use Tv exclusively for bird photography) it forces me to enter ML menu and disable ETTR, therefore slowing the process down, and sometimes I forget if ETTR is enable for when I really wanted ie. in M mode.

My request is to disable ETTR outside M mode as an option (in case that someone wants it back) so I can make use the instant change mode for quick photos between C1, C2, C3.  Also when I switch to M mode my ETTR is sure to be ready for me without having to go into ML menu.

I hope this is possible since it will benefit many users who want that very quick instant reaction of changing per-programmed modes C1, C2, C3

As Always: Thanks for your amazing work.

P.S.  In case it is not clear, I want to leave ETTR ON and not have to turn it OFF (the ETTR module should not work in these modes) when I am in C1, C2, C3, Tv and possible others like Av.
#19
Success!  After a bit of struggling I managed to get a very nice (night to day) timelapse with clean shadows and almost not clipping in the highlights8)

USED 5D3 + ETTR + DUAl ISO

ETTR settings:

Trigger mode. Always on
Slowest shutter: 32"
Highlight ignore: 0.5%
Allow clipping: OFF
Midtone SNR limit: 6EV
Shadow SNR limit: 2EV
Link to Canon Shutter: OFF
Link to Dual Iso: ON
Shadow metered areas: OFF
Show debug info: OFF

Dual ISO (enabled)


Intervalometer:
Take pic every:  1m, Start after: 3 sec, Stop after: Disabled, Manual FocusRamp: OFF

Post Deflicker:

Sidecar file type: Adobe XMP
Deflicker percentile: 50%
Deflicker target level : -4EV


The modules performed very well automatically without any human intervention.  The only thing I noticed is that when Dual Iso kicked in, there were some images that alternated between DUAL ISO 100-200 and no DUAL ISO.  After a while the system stabilized and all of the photos thereafter where DUAL ISO.

POST-PROCESSING with XMP slidecar files (ACR and Photoshop required)
This proved to be the more difficult part since the exposure compensation is not passed through the cr2hdr process.  Maybe this can be updated in a future release making this process a slicker deflicker.  ;)

1. Open all the CR2 files with ACR (xmp files will adjust the exposure) and save them as DNG.
2. Process all of the DNG with cr2hdr
3. Change the extension of all DNG back to CR2.  Make sure the xmp files are put back with the CR2
4. Open the CR2 with ACR (again) and save them as tiff, this will adjust the exposure of the tiff files by the deflicker exposure.   Save then to a separate folder.  Make sure that the exposure compensation is applied in ACR.
5. In Photoshop create a small action to open a file and change the canvas to the correct size of 5760x3840, then save the file.  This is required since the cr2hdr process is increasing the size of the images to 5796x3870. Again this is something that may be able to program in cr2hdr so that the output images do not change in size.
6. In Photoshop open the Batch command (in File, Automate) and select the action you created by selecting the Set and the Action. 
7. Click on Source and select Folder.
8. Click on Choose and select the Folder where you saved the tiff files.
9. Select the Override Action "Open" Commands
10. Select the Override Action  Suppress file Open Options Dialogs.
11. Click on Destination and select Folder
12. Click on Choose and select a folder for the new tiffs
13. Select Override Action "Save As" Command and Click OK.
14. When needed the images are automatically re-sized , you can import these tiffs in your favorite video editor.

Technical Notes;
I also tried sending all the cr2 files directly to the cr2hdr which converted the DUAL ISO images to DNG.  Then rename all the DNG back to CR2 and then along with the xmp open the cr2 to save as tiff.  The problems is that the converted DNGs (converted to CR2) in this manner will never accept the exposure compensation from xmp file.  I tried and tried and could never get them to accept the deflicker exposure.

There are a couple of places (1. and 4. above) where you can adjust shadows, highlights, etc.  I only use tonal curve in ACR to avoid flickering.
#20
Feature Requests / Feature Comparison Matrix
September 20, 2013, 01:40:23 PM
Here are the existing features for reference:

http://builds.magiclantern.fm/#/features
#21
Update: Sept 17
Note: This is brand new and may not work on all cameras.  It works on 5D3 from my testing.  Please let me know if you have tested this modules with other cameras to update this post

If you know nothing about ETTR then go here:
(Auto) ETTR (Exposure to the Right): -- History & Beginners Guide
http://www.magiclantern.fm/forum/index.php?topic=5693.0

If you know nothing about DUAL ISO then go here:
Dual ISO - massive dynamic range improvement
http://www.magiclantern.fm/forum/index.php?topic=7139.0

For a comparison of ETTR and DUAL ISO go here:
Dual ISO vs Auto ETTR
http://www.magiclantern.fm/forum/index.php?topic=7835.0

What is new?

The Auto Exposure To The Right module has now been expanded to squeeze the last bit of information of the camera sensor by the automatic use of DUAL ISO.  This is best used in situations where the high dynamic range of the scene require DUAL ISO to better capture the details of the image.  The latest implementation analyzes the image and automatically decides when to use DUAL ISO.

For the latest ETTR and DUAL ISO Modules go here:
Nightly Builds - try the very latest stuff here
http://www.magiclantern.fm/forum/index.php?topic=3072.0

PLEASE BE ADVISED THAT THESE MODULES ONLY WORK IF YOU HAVE ENABLED THE BOOTFLAG IN YOUR CAMERA.

If you want to enable the bootflag in your camera (550D, 600D, 50D, 60D, 5D2)  then go here:
Magic Lantern v2.3 - Install Guide
http://wiki.magiclantern.fm/install

For other cameras go here for a starting point.
RAW video & ML -- Beginners Guide, FAQ & Useful Links -- READ FIRST
http://www.magiclantern.fm/forum/index.php?topic=5520.0

HOW TO USE IT!

1. The modules are located in the EXPO tab:  Auto ETTR and Dual ISO


2. Auto ETTR has a simple mode:



Click on the Advanced mode to display all of the settings.

3. ... and an Advanced mode:



4. Trigger mode allows you to select three different methods for triggering the use of the AETTR.

    Press SET means that every time press the SET button the current scene is displayed in the LCD monitor with an analysis of the image.
    HalfS DblClick  means that every time double press the Half Shutter the current scene is displayed in the LCD monitor with an analysis of the image.
    Always on means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image.
    Auto Snap means that every time you take a picture the image is displayed in the LCD monitor with an analysis of the image, and that if the results are not adequate it will automatically take another image.

5. Slowest shutter: Set the slowest shutter that will allow for the current scene.

6. Exposure Target: A general exposure target for the scene,  cannot be set to zero but it could be set lower to expose darker.  This is not really used very much, usually left at -0.5

7.  Highlight ignore:  Percentage of (highlight) pixels to ignore when calculating ETTR.  This is used if you want to allow overexposure in the highlights, for example room lights.  Typical setting is 0.2% and means ignore almost nothing.   If you want to ignore more highlights try 1, 3, 5 or even 10%.

8.  Allow Clipping:  No clipping  This selection allows to select Clip Green channerl, and Clip ANY channel.   Only used if you want to allow clipping of higlights for any channel or only Green Channel specifically.  Some people will allow for some green channel clipping since there is more detail information on the other channels.  This would allow for the maximum exposure to the right and yet maintaining the highlight details.

9. Midtone SNR limit: Is defined in EV levels of noise in the Midtones form 1 to 8 EV.  The higher the SNR the less noise.  Typical settings from 4 to 8 EV.

10. Shadow SNR limit: Is defined in EV levels of noise form 1 to 4 EV.  The higher the SNR the less noise.  Typical settings from 2 to 4 EV.

11. Link to Canon shutter:  This links the Slowest shutter to the shutter value you set via small scroll wheel.  This is very useful for quickly changing the Slowest shutter without having to go into the ML menu.  Just set the shutter speed and on the next photo Slowest shutter = new shutter.

12.  Link to DUAL ISO: ON or OFF.  In ON position the camera will analyze the scene via Trigger mode (4) and decide if DUAL ISO is required or not.  Requires the DUAL ISO module to be enabled.
Note: If Link to DUAL ISO is set to OFF, the module will not calculate the required DUAL ISO and the image will only be set to meet the ETTR requirements.

13. Show debug info: ON OFF.  Will show some of the important calculation results of this module.

Convergence to results:

a. This module with require at least two images (sometimes three or four) to come up with the proper exposure.  Alternatively you can set the Trigger mode to Set in which case the camera will go to live view, analyze the scene, and return to photo mode with the correct settings.

b. When the algorithm cannot find an adequate exposure it will beep twice and give you a message in the LCD screen. ETTR: expo limits reached, indicating the ISO and speed limits used.

c. When the algorithm finds an adequate exposure it will beep once and give you a message in the LCD screen. ETTR settled at ISO xxx and the shutter speed.
Note: the image review time in the LCD is set via Canon menu in Image Review.  You may want to put 8 seconds so you can see the results in the LCD before it turns off.

Raw histogram use:

It is best to enable RAW Histograms via Global draw.  This will put a little histogram on the LCD during image review.  This histogram can show an ETTR hint (how many EVs are required to reach ETTR), or the Dyanmic Range of the image.  It will also show the clipped channels via colored numbered circles.

If you also enabled RAW zebras via Global draw, you will also see, if any, areas of the image are over-exposed.  Black will be completely overexposed, then you can see red, green, and blue channels clipped areas shown with their respective colors.  White will be dark areas completely under-exposed.

More about SNR Levels:

Here you can find some samples at different SNR levels:
http://www.magiclantern.fm/forum/index.php?topic=5200.msg70150#msg70150

Some test I did here:
http://www.magiclantern.fm/forum/index.php?topic=7835.0
#22
The new AETTR module now has two new options which allow for better control of the highlight exposure function.  I have tested these options and obtained very impressive results..

In the past I had used the highlight ignore function to change the amount of overexposure in the highlights and this worked very well but it was time consuming.  In this update now it is possible to obtain some impressive results by setting the amount of noise that we are willing to accept in the shadows and midtones.  At first this does not lead to a quick understanding of the function and its application but by testing I have a better understanding on how to use it.

The midtones SNR limit varies from 1EV to 8EV.  I think of it 1EV = lots of noise and 8EV = no noise.  So if you want strict control of the noise in midtones then set it to 8 and the module will raise the highlight ignore until the midtones are perfectly exposed to the right.  If the scene has lots of dynamic rang then the highlights will be blown out (ignored) to maintain a proper exposure to the right in the midtones.

Here you can find a more details on this subject and excellent  samples by Audionut  on the midtones exposure: http://www.magiclantern.fm/forum/index.php?topic=5200.msg70150#msg70150
The shadows SNR limit varies from 1EV to 4EV.  I think of it 1EV = lots of noise and 4EV = no noise in the shadows.   So if you want strict control of the noise in shadows then set it to 4 and the module will raise the highlight ignore until the shadows are perfectly exposed to the right.

The most important feature of this options is that you can independently control these two limits, one is how much noise is in the shadows, and the other is how much noise in the midtones.  If we use both functions then the resulting image will depend on which of the two limits will be hit first.  By having two options measured at once, there is better control of the highlight ignore function in a much quicker way than setting the h.i. from  0 to 50%.

The module is enabled as default midtones at 6EV and shadows at 3EV.  This will ignore a great amount of the highlights in return of properly exposed midtones and shadows.   This is the equivalent of setting highlight ignore of 2 to 3%.  But if the scene has lots of shadows then the shadow limit  will kick in and raise the highlight ignore to say 10%.  This means that the module is automatically adjusting the highlight ignore to meet my shadow requirements.

By using these two settings now we have a much more usable module which adjusts the highlight ignore to meet our requirements.

From my testing:
Indoor photography ignoring highlights from windows set midtones = 6, shadows =3
For outside photography in bright lights only ignoring extreme highlights m=4,  s=2
I have also used it for night-to-day Timelapse and found that m=4 and s=2 gives some nice results.  Usually the shadows are very dark when the sun starts to come up, with this setting I get enough light in the shadows to bring them up in post for a good final compromise.  If I use m=6 and s=3 the night will be overexposed but the shadows in the transition will be better.  I don't like this option because it forces the camera to use very high ISO at night.
#23
Feature Requests / Aliasing correction in 60FPS RAW Video
September 02, 2013, 02:11:32 PM
Can the aliasing research included in the cr2hdr be applied to stretched 60/50/48 fps video?
I tried to use it with the DNG but it is not a dual iso file so it does not processes it. 
#24
Tutorials and Creative Uses / Dual ISO vs Auto ETTR
August 22, 2013, 08:20:56 PM
By increasing the highlight ignore in the Auto ETTR module it is possible to significantly improve the quality of the shadows in situations where the dynamic range of the scene is beyond the capabilities of the camera sensor.  The cost is the lost details in the highlights.

In my testing, I found that the DUAL ISO module increased the dynamic range of the camera but the noise in the shadows and sharpness in the brights is better by using Auto ETTR technique if some of the highlight details can be sacrificed.

If you must capture all highlight details and are not bothered by noise in the shadows and some loss of detail in the brights then DUAL ISO is capable of delivering the goods.
Here is the setup I used to test Dual ISO vs Auto ETTR


With Canon metering (Evaluative metering) the image has very deep shadows with lots of noise and the highlights were slightly overexposed



With the Auto ETTR (AETTR) module enabled in default settings (02.% h.i.) there is a slight improvement in the highlights (better exposed) while the shadows are a bit deeper.  This has been my experience with AETTR, if there are highlights, then it always meters them accurately to prevent any highlight overexposure.  I all cases where there is an excessive Dynamic Range then the AETTR will always underexpose the image to protect the highlights.  To counteract this issue, if the highlights are not so important, then I raise the highlight ignore setting until the image looks right.  In most situations with bright clouds I can get away with a 5 to 10% in the highlight ignore and still get good results.

AETTR default (0.2% h.i.)



AETTR  +5%



AETTR +10%




Now if we use the DUAL ISO module we will see how the shadows are lifted while the highlights are not overexposed and the benefits of increasing the second ISO.

Dual ISO 100-200



Dual ISO 100-400  Notice that the shadows are lifted slightly more than 100-200 image



Dual ISO 100-800  Notice that the shadows are lifted slightly more than 100-400 image



ADVANTAGES AND DISADVANTAGES DUAL ISO

In the following comparisons I have brought all of the RAW photos into Photoshop via ACR 7.1  and used the Auto exposure function which automatically does its magic to raise the shadows and lower the highlights to some predetermined "magical value".  I use this to quickly bring all the images to the same magical look as a standard point for comparison.  In am hopefully comparing images that have been adjusted to the same standard look of "Auto".

The following comparisons show various areas of the images where each feature will show its advantages and disadvantages.  The side-by-side comparisons will be made in the highlights, brights, Mids, and Low lights areas of the photo.  I have not used any technical definition for these exposure areas just my perception of what is highlights, brights, Mids, and Low lights.

Here are the camera settings for each photo:

DUAL ISO 100-200,  1/25,  f/14
DUAL ISO 100-400,  1/25,  f/14
AETTR +5%,  1/25,  f/14, ISO 100
AETTR +10%,  1/25,  f/13, ISO 400

Note: I did not record the exposure compensation for each image.

First, look at the highlights:


By increasing the highlight ignore of the AETTR module obtained the following comparison between Dual ISO and  AETTR.



Clearly at AETTR+10% we lose some of the details in the fog, in this case this does not represent any significant loss in my perception for this image.  AETTR+5% looks better but not as good as ISO 100-200.

The Dual ISO feature has conserved the highlights very well.

Second, lets consider the brights:


A problem of DUAL ISO  here becomes evident (due to aliasing) with the loss of resolution in the high contrasting areas of the chart.  This is probably due to the aliasing reduction algorithms which reduce the details at the expense of resolution.   The sharpness defects become much more pronounced with the 100-1600 and 100-3200.


Third, now looking at the Mids and low lights:

In this area of the image the noise becomes more evident and the clear winner is the AETTR+10% (at ISO 400).  The Dual ISO images are not so good and there is some horizontal noise banding appearing in the smooth brick areas.  Look below the "1" on the 100-400 image.  This banding becomes much more apparent after denoising and sharpening.



Fourth, finally the Low Light area:

The winner is AETTR+10% with less noise. Horizontal banding is still evident in the Dual ISO images.



I have also compared the AETTR+10% with the 100-800 and the 100-1600 and the 100-3200.  In the image below I raised the shadows by 10% to get a bit more detail.  Again the AETTR+10% is a very good results giving higher sharpness and very little noise.  The 100-3200 is also very good but I would not consider this option as ideal since it has lost too much details in the brights due to aliasing.  Note that horizontal banding is not evident at these higher ISOs.



MY FINAL CONCLUSIONS


1. If you have a scene with large dynamic range and need the details of the highlights and shadows then Dual ISO will be the only option.
2. If you can sacrifice a bit of details in the highlights then AETTR is better suited for the job since the noise is lower and there are no problems with aliasing.

I hope that my analysis is correct and if there is something wrong I would like to know what I did wrong to correct it!





#25
Hope to resolve some issues for me and for other Windows users who want to compile in their windows machines.

For a Guide for those who want to install VirtualBox and contribute with their programming skills go here:
http://www.magiclantern.fm/forum/index.php?topic=6783.0

For solutions to the following problems just skip the Quick Guide:

1. Cannot empty trash
2. How to set up Shared Folders between Windows 7 Host and my guest Ubuntu
3. How to add Virtual Hard Drive to VM
4. How to re-size the VirtualBox HD (found on post no. 5) here: http://www.magiclantern.fm/forum/index.php?topic=7579.msg66782#msg66782
5. "make install" command found here: http://www.magiclantern.fm/forum/index.php?topic=7579.msg77314#msg77314


Quick Guide HOWTO VirtualBox

1. Downloaded the VirtualBox here: http://nanomad.magiclantern.fm/Development%20Box/VirtualBox/MagicLantern.zip

2. Downloaded Oracle VirtualBox here: http://download.virtualbox.org/virtualbox/4.2.16/VirtualBox-4.2.16-86992-Win.exe

3. Installed VirtualBox on Windows 7 ultimate 64 bit

4. Unzipped the contents of  MagicLantern.zip

5. Ran VirtualBox, click on New, Typed a name, Selected Type: Linux, Version: Unbutu

6. On next screen set Memory to 1024 (I have 12 GB)

7. On next screen clicked on Use an existing virtual hard drive file, clicked on the folder icon, and selected the MagicLantern.vdi

8. Now I have the new machine on the left menu in VBox.

9. Click on Start and accept all default settings.

10. Now I have Unbutu Running

11. Double click on Home (Top left)

12. Right-mouse click on magic-lantern and select open terminal here

13. Type hg pull

14.  When done type hg update

15.  Double click on magic-lantern folder

16. Double click on Makefile.user file

17. After GCC_VERSION= add "-" sign should now read:
      GCC_VERSION=-4.7.3

18. Below the GCC add:
      CONFIG_TCC = Y
      CONFIG_MODULES = y
      CONFIG_PICOC = Y


19. I had also added  CONFIG_MEMCHECK   = y  but this gave me some errors so I took it out!  (Is it needed?)

20. Under File menu click on save and then quit

21. Now Click on magiclantern on the left side with the home symbol

22. Right mouse click on the magic-lantern folder on the right and select Open Terminal Here

23. Type: make clean and when done make 5D3

24. It should work.  It compiled.

25. Now go back to the File Manager and open the magic-lantern folder and then the modules folder

26. Right-mouse click on each module that you want to use and select the Open Terminal Here

27. For each one do a make clean and when finished type make.

28. When done.. Go to File Manager, open magic-lantern folder and platform folder and 5D3.113 folder

29. Copy the 5D3_113.sym and the autoexec.bin files to ... USB drive.

Here I had some problems but these problems were solved in the following way.. Insert the usb drive and close the windows automatic usb recognition.  Then go to VBOX click on Devices, USB Devices, and select the USB drive inserted.  Now Vbox adds this drive to the File manager.

30. Open the USB drive shown on the File manager.  When you see the drive then proceed as follows:

31. Select the 5D3_113.sym and the autoexec.bin files, right-mouse and click on send: select the usb drive.

32. Click on magic-lantern folder (above the main window), double click on Modules.

33. Go into each module generated and copy  each xxx.mo by selecting it (right-mouse click) and sending it to the usb drive.

34. When done click on Devices, USB Devices, and on the usb drive.  This removes the drive from the Vbox.  In my system then Windows recognizes the USB drive, and then I can copy and transfer these files to the card reader.



------------------------- Solutions found --->>>>


1. Cannot empty trash..

I am not sure why this happen but I suspect it has to do with deleting files in USB stick, then removing the stick (from linux) without emptying the trash, and then deleting all files under windows including the hidden .Trash-1000 hidden file which is created by linux.

1. With VM running use Terminal and run command: sudo rm -rf ~/.local/share/Trash
2. Go to Virtualbox menu and click on Machine, ACPI Shutdown.
3. Start the same machine.
4. A new screen will appear that informs of an error press continue and the (I think) press the F to fix the error.  After a while the machine will reboot and the Trash can will have been fixed.
5. My problem is that I never shutdown the machine so the system could not fix the problems.

Conclusions:
a. If you delete files from USB stick, empty the trash before you disconnect it from Linux.
b. It is always a good idea to shutdown or reset the machine when trying to fix some of the problems.


------------------------- Solutions found --->>>>


2. How to set up Shared Folders between Windows 7 Host and my guest Ubuntu

To install the guest additions first you have to get the required files not included in the system!

1. Open Terminal
2. type the following command and hit enter:
apt-get install dkms build-essential linux-headers-generic
... this will download and install the required packages.

More questions answered here: https://forums.virtualbox.org/viewtopic.php?t=15679

3. When finished type in the terminal and hit enter
sudo sh ./VBoxLinuxAdditions.run

This will install the Guest Additions in the machine...

4. Go to Devices, Shared Folders, click on Machine folders and click on the green folder icon with a + sign.
5.Click on Folder Path, Other, and select the folder in Windows that you want to share.  Can be an entire drive if you just select the drive letter.
6. Type a simple folder name i.e shared
6. Select Automount and Make Permanent, ok
7. In the terminal now type:
sudo mount -t vboxsf name-of-folder /media

Make sure the name-of-the-folder (this is the name that you type when adding the shared folders in 5. above) has no spaces then leave a space after it and before /media
/media is the directory where the shared folder will be mounted.  Could be any other directory.

This will mount the shared windows folder to the media folder which is inside the File System.
More questions about this subject answered here: https://forums.virtualbox.org/viewtopic.php?t=15868

To remove a previously shared dir shut down the machine and remove the shared folder in the settings of the VM.  The run the VM and use rmdir sf_nameofdir command to remove it from the /media directory.

AUTO LOADING AT BOOT

The above mounting procedure (7.) will have to be repeated every time the machine is started form shutdown condition.  If you want to to auto loaded then it is necessary to add the mount command to the  file /etc/r.local with:

sudo nano /etc/rc.local  (This allows to edit the rc.local)
note: If this is the first time take out the # sign on the first line
add..
sudo mount -t vboxsf name-of-folder /media
before the last line i.e. exit 0
Ctrl+x to close
y to save
enter to write

The nano terminal should close saving the change.

Reset the machine and test it..  Make sure that the sudo command on 7. is working (shared folder is available in linux) before you add the command to the rc.local file.


------------------------- Solutions found --->>>>

3. How to add Virtual Hard Drive to VM:

Since I am still struggling to get more space added to my virtualbox, I have opted to add a second hard drive to my machines so I have the necessary space when I can process videos in linux.

This is not absolutely necessary if you use the shared folders on your windows machine to store all of your big stuff.  Additionally you can run the linux raw2dng, cr2hdr, and mlv_dump in the shared folders.
But if you still want to add a second virtual hard drive to the VM the follow these instructions.

1. Open Oracle VM Virtualbox Manager and click New
2.  Name : 50GB-HD, Type:Linux, Version:Ubuntu, Click Next
3. In Memory size just click Next
4. In Hard drive, select Create a virtual hard drive now, click Create
5. Select the VDI (VirtualBox Disk Image), click Next
6. Select Dynamically allocated, click Next
7.  With the slider change the size of the disk and click Create.
     This will put a VM-disk on the list.
8. Next step is to add this disk to our MagicLantern machine.  Select the MagicLantern VM machine.  Make sure this machine is Powered Off.  If your machine is not Powered Off: selected it, right mouse click, and select the Discard saved state icon.  Can also be done from the main menu.
9.  Click on Settings in main menu.
10. Click on Storage and the new screen will show the drives mounted on the right.
11.  Select the hard drive controller (not the disk)  where you want to add, usually the one that already has the virtual machine. 
12. Note that there are two icons right of the controller, the first one is to add a CD/DVD and the second is to add Hard Disk.  If you hoover your mouse over these icons, the description will show.  Click on the add Hard Disk plus Icon.
13. Select  Choose existing disk now navigate to the directory to where you saved the disk created in step 7.  In my machine this is stored in C:\Users\RE\VirtualBox VMs\10gb-hd.  There will be a .vdi file with the name of the hard drive form step 2. ie 50GB-HD.  Click Open.
14. The new HD is added to the machine and it is automatically assigned to the controller. Click OK and now Click on Start in the main menu.
The new drive is added to the machine but it needs to be formatted.
15. First we need to confirm that the HD has been added and where it is located.
   Open Terminal and type: sudo fdisk -l  <<-- is a minus (L) no-caps
You will need to enter the password for magiclantern: 123456
16. This will bring up the disk and partitions detail of the machine:
--------------------------
Disk /dev/sda: 21.0 GB, 20971520000 bytes
255 heads, 63 sectors/track, 2549 cylinders, total 40960000 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000b6f22

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048    12582911     6290432   83  Linux
/dev/sda2        14682102    18872311     2095105    5  Extended
/dev/sda5        14682104    18872311     2095104   82  Linux swap / Solaris

Disk /dev/sdb: 54.8 GB, 54766731264 bytes
255 heads, 63 sectors/track, 6658 cylinders, total 106966272 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/sdb doesn't contain a valid partition table
--------------------------------
Notice the last line:
Disk /dev/sdb doesn't contain a valid partition table

This is the new disk that has installed but does not have a partition, the disk is installed in the directory /dev and the name is sdb i.e.  /dev/sdb

17. In Terminal and type:
mkfs -t ext3 /dev/sdb   (In your case type whatever the fdisk command showed for the dirve on the last line.)
18. After the password the terminal will ask you that /dev/sdb is enire device, not just one partition!
Proceed anyway (y,n)
Type y
now ...the drive will be formated for you
When done the drive will appear on the desktop and in the file system
19. to confirm installation right-mouse click on the new drive and open.  It should automatically mount and open.
20.  Notice that you cannot copy or paste any files to this disk....  As a windows user I want total access to this drive so I will change! the read write permissions to this drive.  I thought this would be easy but noooooo!!!  This is linux.. everything is hard.. get used to it.  I tried so many things but nothing worked until I installed this nautilus utility.
21. Open Terminal type: sudo apt-get install nautilus
22. I dont remember all of the details about the installation but when done reset your machine, open terminal and type:
sudo gksu nautilus
23. Navegate to the /media folder in the file system
24. Right click on the drive and open Properties
25. Under the Permissions tab change permissions to read/write
25. Same place change the owner and group to MagicLantern and magiclanter respectively.  These should be selectable from drop down menu.
26. Click Apply permissions to enclosed folders.
27.  Whala!  check your new drive by creating a new folder o copying something to it.

This drive will act as a External drive to any VM machine.  So if you want to add this HD to another VM just do steps 8. through 14.
#26
Feature Requests / Enhacing Usability of Auto ETTR
June 13, 2013, 01:15:16 AM
So far, ETTR is a fantastic tool.  My only problem is making a quick exposure adjustment like I do with raising or lowering the EV by using the "half-shutter" and Large Scroll Wheel on the 5D3.

I know this is the equivalent of asking Auto ETTR to undo what it has done... 

But maybe there is a way to allow users to quickly switch between ignoring the highlights, or the specular highlights and telling ETTR to optimize the other part of the image.  I know we have the Highlight ignore % which does exactly what I want but it is too slow and not user friendly to dig into the ML menu to up this value, shoot, look at the results and change it again.

One way would be to use a quick set-up much like the Canon Shutter link that allows changes quickly in shutter speed.

Another way would be using the Set + Small Scroll Wheel during the image review (in ETTR mode) to quickly set a new exposure level in the image at LV.  This would allow the use to say I want my picture exposed like this and then the camera would calculate a % ignore value that would give that exposure look.  The main purpose of this would be to give the user an ability of quickly determining how much of the highlights should be ignored, in real life, with the image showing in LV.
#27
For some circumstances I like it when the camera takes the needed shots to get Auto ETTR.  But there are a lot of times when I am wasting the shots because the camera keeps shooting while I am moving to the next target. 

Please provide an option to turn the multiple auto exposure ON-OFF

I like the one beep confirmation of proper exposure and two beep for bad exposure.  I like to decided when to keep shooting... Usually once a good exposure is reached I will shoot my subject until I fill the buffer, this way I can choose the best pics. 
#28
Feature Requests / Photos to SD and Video to CF
June 11, 2013, 03:47:42 AM
Since CF is so important for video I am wondering if the photos could be sent to SD and record RAW video in CF.  I know I can transfer the photos from CF to SD but this consumes extra power and time, none of which I have to spare when I am doing wildlife photography.
#29
I used ETTR with wildlife photography and it produces excellent results.  I am in love with ETTR always On feature!

I see a need to change the slowest shutter speed as I switch from one situation to another.  For example a hummingbird at 1/1000 or shooting a flower at 1/60.

Since the only shutter setting in ETTR is the lowest shutter speed, can this be tied to the shutter speed adjustment wheel?  This will make in my situation a much faster adjustment than going into the menu ...

Thanks for a great piece of software.

#30
I found some discussions burried in the threads about this aspect of video so I am creating a new thread to discuss it further if it is needed.  The last discussion that I could find a solution read:

Quote from: Shield on May 26, 2013, 11:42:56 AM
Well, I've basically been up all night trying to get the audio sync working for the 5d3.  After much trial and error, I've found that about a 103% "time stretch" does a really great job.  It's between 103-104%; probably 103.2 would be damn near perfect.  Make sure you whack the end of the audio file off first before you do the stretch.
I tested this on a 4 minute clip and it's off by maybe a nanosecond all the way at the end.
Keep in mind this is with FPS override ENABLED, and set to 24p.  If I disable this, the video gets waaaaay ahead of the audio and then "catches up" and I lose even more sleep.  :)  Hope this helps someone who shoots without an external recorder.  Workflow = Adobe after effects CS6.

You can trim the furthest point of the wav file in your composition by hitting the "alt" and ] keys (will remove everything to the right).
Shawn

Please contribute here if you have any other discussions about this topic.
#31
If you have never seen a Timelapse go here: http://timescapes.org/

If you want to learn all the basics and advanced methods to obtain timelapses go here: https://timelapse.org

Make sure you go to the Forum for the latest discussions on this subject. https://timelapse.org/forums/

.. But if you want to learn how to use the latest Flicker Free ETTR Timelapse feature in ML continue reading...




Flicker Free ETTR Timelapse -- Camera Options -- Prerequisites


For the actual post deflicking, you may want to use the post deflicker module with instructions below, or this Script for deflickering and ramping ACR (.xmp) settings in Bridge by dmilligan.




ETTR Flicker-Free Timelapse  (ETTR-FFT) -- HOW TO USE IT (step-by-step)

First we set up all of the ETTR features:

1. Go to Canon Menu and set Image Review to some other setting then OFF.  2 seconds is fine.

2. Put  the camera in manual mode M.

3. Press trash button to enter ML menu.

4. Go to the Expo Menu and enable Auto ETTR by pressing set.

5. Press Q if you want to change ETTR settings.  Default settings are good but you may want to adjust Slowest shutter depending on your needs.

6. Press Q and move to Overlay menu.  Make sure Global Draw in On, all modes.  Enable some raw based exposure feedback.

7. Go to the Shoot menu.

8. Scroll to Intervalometer and press Q to change it to wanted settings.

9. Before we enable the intervalometer we want to preset the camera ETTR so press trash button to return to photo mode.

10. Take two or three pictures until the RAW histogram ETTR hint is less than 0.2

11. Erase the pictures you took and press trash button to return to ML.

12. You should be in the Shoot menu, scroll to the intervalometer and Press Set to ON.

13. Press trash button to exit ML menu.  The intervalometer is now functioning and the red led will blink as long as intervalometer is working.  The intervalometer will start depending on the start trigger setting.

NOTE:  If you set your intervalometer at 30 seconds and your slowest shutter speed at 30 sec, you will have problems.  Set the intervalometer at least = Slowest Shutter speed plus the review image setting, in Canon Menu, plus 3 more seconds.  So if the slowest shutter is set to 30 seconds, the intervalometer should be set to at least 40 seconds or more.


If you are using the Post Deflicker module, there are some other options you should set.

1. Scroll to Post Deflicker and press Q.

2. Set Sidecar file type to UFRaw or XMP , and check the other settings i.e 50% and 4 EV.






Watch the camera for a couple of shots to make sure that the images are good and ETTR is settling nice for a long day or night of work. 

Come back from time to time to make sure it is doing a nice job...

wait all day .........

While you are waiting for the timelapse lets get going on setting up the software to process the files.


Post Processing ETTR-FFT Basic Steps


XMP WORKFLOW for PC

1: Make sure your camera time is not ahead of the computer time you will be using.

2: If the name of your CR2 file does not agree with the xmp, change the XMP always.  In this manner the xmp will be modified after the CR2.  If you do it the other way ACR will not read the files.  Always the CR2 Modified Time Stamp mus be before the xml Modified Time Stamp.

3. Once you have the cr2 and the xmp ready for processing you open all of the cr2 files with ACR at once.  If you have too many files for your pc capabilities then do them in groups.

4. In ACR click on Select All. Top left.

5. Make sure that the sliders are not modified in the Basic tab.  Do all the exposure adjustments in the Tone Curve tab.

6. Click on Save Images (Bottom Left) and choose your preferred type.  I use tiff for best results.




Adjusting exposure for XMP with exiftool

With this little tool you can also adjust the exposure of the xmps but you cannot ramp the exposure.

Dowload exiftool here: http://download.cnet.com/ExifTool/3000-2193_4-10791213.html
Place it in the directory where the xmp files are.  (Always make a copy of the original xmp)
Open the DOS promt (Type cmd at the windows comand line)
Navegate to the directory where the xmp files are located
Type: exiftool -Exposure2012+=x *.xmp
Where x is the ammount of adjustment, could be +ve or -ve.
The exiftool will report back how many files where adjusted.
If you do not put the + sign after the 2012 exfitool will just set the x exposure to all the files.  With the + sign it will add that exposure to the xmp.




TROUBLE SHOOTING XMP WORKFLOW

ETTR is a module to expose your images to the right so as to maximize the signal-to-noise ratio, meaning have lower noise in your shadows and probably better color.  ETTR has nothing to do with deflicker, it is just exposing each image to the best of the cameras abilities to try to capture all the details possible.  This module has become more complicated and powerful and now you have better control of what is that you are trying to capture best.  For more information go here: http://www.magiclantern.fm/forum/index.php?topic=5693.0

If the change in exposure from one shot to the next is extreme, then ETTR will be going all over the place trying to adjust to each exposure.  For this reason it could seem that exposure ramp via AV or Auto ISO is smoother.  I have experienced this kind of variation when the interval time  in the intervalometer is very long, ie 2 minutes.  I never use ETTR with and interval time longer then 1 minute.  I had a situation with passing clouds where the exposure was varying quickly and ETTR produced very bad results so a shorter interval time is always better.  In some cases it may be better to use other exposure methods.

Also do not set the intervalometer to take pictures every 2 secods because there will not be enough time for ETTR and Postdeflicker calculations.  Minimum intervalomenter setting should be above 10 seconds.

ETTR is not an instant perfect photo mode, what I mean is that it can take more than two shots to get the software to converge into an ideal exposure to the right.  So if the exposure changes from one shot to the next then ETTR is in a hunting mode, AND in this case do not use ETTR.

Post Deflicker is another beast all by itself.  I dont know the math behind this but it must assume some kind of average exposure ramp and it adjusts each shot via xmp file so as to bring the exposure of that shot very close to the average exposure ramp.  I assume that this algorithm can also get somewhat screwed if there are a lot of exposure changes from one shot to the next.

Assuming that all is working properly, when you import a cr2 file into ACR or lightroom, it has an exposure adjustment of zero, but when the software reads the xmp file, then the exposure will be adjusted by some amount sufficient to bring the exposure to some predefined standard by the Post Deflicker algorithm.  For example when I open the files in ACR without the xmp files and I walk through the images, it is clear that the exposure is changing from one image to the next.  If I open the same files accompanied by the xmp file, then the exposure change from one image to the other is minimal, and I can see how the exposure slider changes from one image to the next.




XMP WORKFLOW to ADD an Exposure OFFSET for MAC

Quote from: ColinWarhurst on September 28, 2013, 03:35:05 PM
Doyle; many thanks, your tutorial worked a treat.

Haven't quite worked 'how' it has worked, but I seem to have ended up with some additional XMP files with the suffix 'original' at the end of them. Perhaps Exiftool is being friendly and making backups of the originals?  :P

To clarify (if anyone else is having the same issues) this was my process;

1 - Download and install exiftool FOR MAC (There is a specific Mac OSX package)
2 - Prepare/move CR2 files and .xmp files from Magic Lantern in one folder
3 - Open Terminal
3 - Enter the command as Doyle explained above;

exiftool -Exposure2012+=+*.** /drag folder here containing cr2's and .xmp's


Where the *.** is enter the amount you want to set
eg 0.05, next to the number you have chosen
Too the left is +
+=over expose
-= under exposure

4 - Allow process to run (New/backup XMP files were created for me. I waited until the list had finished)
5 - Select all CR2 files, open in Adobe Camera Raw
6 - FILES SHOULD OPEN, DE-FLICKERED
7 - Select all, make White Balance auto. (Unsure about next bit?...)
Make any edits should you want them? Note, that if you change exposure now, you'll undo the de-flickering!
(Perhaps edits should be done first, then you start the de-flickering command afterwards? Needs testing!)
8 - Close Adobe Camera Raw
9 - In After Affects, import the first CR2 image, select 'Camera Raw Sequence.' Create timelpase!

Many thanks Doyle! Maybe this Mac step by step should be added to that top post/tutorial thread?

More on this subject on the original post here: http://www.magiclantern.fm/forum/index.php?topic=6789.msg78647#msg78647

Also if you need to rename multiple files in Mac:  http://namechanger.en.softonic.com/mac

Exiftool plugin for lightroom. (Thanks Dane)  http://www.robcole.com/Rob/ProductsAndServices/xEmPLrPlugin/




UFRAW WORKFLOW


1. Download UFRAW basic version.  You can find it here in many flavors:
http://ufraw.sourceforge.net/

I used the windows for dummies version from here:
http://sourceforge.net/projects/ufraw/files/ufraw/ufraw-0.19.2/ufraw-0.19.2-2-setup.exe/download

2. Install it all default settings.

3. Download this little .bat file I created to run it in batch mode here:
https://docs.google.com/file/d/0B9z8Y0rg-pu8bE9XaUdQcnJPQzA/edit?usp=sharing

or.. make your own bat file with the following commands:

cd C:\Program Files (x86)\ufraw\bin
ufraw-batch I:\ufrawconvert\*.ufraw --out-type=jpeg

Note that you must have the correct directory for   \ufraw\bin

Also note that you must have another directory selected for the place where you put the timelapse files, in the above example it is I:\ufrawconvert\

3a. If you downloaded the bat file you will have to edit.  Note that if you placed that bat file in the C: drive you will have to start the notepad as an administrator; this also depends on what type of operating system you have.  so before you move it to the C dir, just edit with the necessary changes. 

3b. Now save it and copy it to the \ufraw\bin directory.  Again you may need administrator permits to do this.

3c. Now create a short-cut (select the file, right mouse, Shortcut) to this file and copy it to your desktop.

If you double click on this link the ufraw batch system will kick in and start processing the files.  But before you do this lets go to step 4.

4. Wait for the timelapse to finish, and then we are going to copy the files to the I:\ufrawconvert\ directory, or to whatever directory you set in the bat file.

MAKE SURE YOU COPY THE .CR2 and the .UFR files.  There should be a corresponding .UFR  file for the .CR2  If the names don't match then we will have to rename them.  More on that later.  For now just copy them.

5. If the names are not identical then download Bulk Rename Utility here:
www.bulkrenameutility.co.uk  (Also in Mac:  http://namechanger.en.softonic.com/mac)

6. Open Bulk Rename Utility and navigate to where your files are.   There are a lot of options on this little thing but we will only use a couple.  Our goal will be to make the .CR2 files names match the UFR files and then to rename the .UFR files to .UFRAW.

Let's assume that the CR2 file says IMG_7064.CR2 and that you want to change it to HP6A7064.CR2

Click on the CR2 file, now look at the third selection column (below the files) on the top row and it should say Remove.  On the little box that say first you can enter 4 to remove the first 4 letters from the file.  Now the CR2 file should  read 7064.CR2.  Now look to next selection column where it says ADD and in prefix put HP6A.  Now it should read HP6A7064.CR2  If you have it right then select all of the CR2 files and press Rename on the bottom right corner of the application.

But note that the numbers must be corresponding so make sure you do not change any numbers.

Now select one of the . UFR files and reset the boxes that you previously modified.  Find the selection column number 11, this is Extensions.  Click on the drop-down box and select Fixed, type the UFRAW extension.  Notice how the HP6A7064.UFR is now renamed to HP6A7064.UFRAW  If all looks good then select all of the UFR files and  press Rename on the bottom right corner of the application.

Done!

7.  Go back to your desktop and double click on the shrortcut-link you created for the batch file.

If all goes well you will see UFRAW going to work... for a long time

8.   Watch the program details because it may not send the files to the destination folder.  The first time I ran, it worked flawlessly but the second time it sent the files to a \ufraw\bin directory but I could not find them.  In my case it says it is going to the C:\Program Files (x86)\ufraw\bin directory but I found them in the C:\Users\RE\AppData\Local\VirtualStore\Program Files (x86)\UFRaw\bin   

To simplify the whole process I went to this directory, went up one level, and made a short-cut which I copied back to my Desktop.  So now I have a shortcut for the batch file and a shortcut for the directory where it saves.

After all of the files are processed get them out of there to another DIR and import them to your video software.




Todo:  Add some silent pic specific stuff.
#32
Looking for a little information about Exposure to the Right, here are some articles that will help to explain the benefits of this exposure technique.

http://www.luminous-landscape.com/tutorials/expose-right.shtml
http://www.luminous-landscape.com/tutorials/optimizing_exposure.shtml

The luminous-landscape information was provided thanks to Michael Reichmann.




Loading the module

To use this feature, you must first load the module in the module tab:



After restarting the camera, you will now find the module located in the Expo tab:






Using the module

First, lets take a look at the default options:




Trigger Mode:

  • Always On:  AETTR is always active.  In photo mode through the viewfinder, this means that AETTR is always inspecting the exposure in the image review, and setting the exposure settings for the next shot.  In Live View, this means that AETTR is always looking at the image in the live view, and adjusting the exposure settings as necessary.

  • Auto Snap:  After taking a shot, AETTR will take another shot if necessary.

  • Press Set:  AETTR activates by pressing the SET button.  In photo mode through the viewfinder, AETTR will turn on live view, determine the correct exposure settings, and return to photo mode.  In live view modes, AETTR will determine the correct exposure settings.

  • HalfS DblClick:  This functionality is exactly like Press Set above, except the trigger button is half pressing the shutter button twice.

Slowest shutter: 

  • Set the slowest shutter speed that AETTR is allowed to use.

Highlight ignore:

  • Set the amount of pixels in the image, that are allowed to be overexposed.
  • This works like an specular highlight control.

Midtone SNR limit:

  • Set the minimum Signal to Noise Ratio of the median brightness level.
  • "The median "brightness" gives you the signal level, so we can use the SNR. So, when I say the midtone SNR is 5 EV, this means half of the image has a SNR less than 5 EV, and the other half has a SNR higher than 5 EV. Pretty easy and statistically robust".
  • http://www.magiclantern.fm/forum/index.php?topic=5200.msg70012#msg70012
  • Note:  This setting by itself, overrides the overexposure control of AETTR.  This means, that AETTR will overexpose the image as needed, to hit the SNR limit set here.

Shadow SNR limit:

  • Set the minimum Signal to Noise Ratio of the shadows.
  • "For shadows, I've chosen the 5% percentile. So, in this context, the shadows having a SNR of 3 EV means 5% of the image pixels have a SNR lower than 3 EV, and the other pixels will be brighter than that".
  • http://www.magiclantern.fm/forum/index.php?topic=5200.msg70012#msg70012
  • Note:  This setting by itself, overrides the overexposure control of AETTR.  This means, that AETTR will overexpose the image as needed, to hit the SNR limit set here.

Link to Dual ISO

  • Let ETTR change Dual ISO settings so you get the SNR values in mids & shadows.  It will disable dual ISO if not needed.
  • With the SNR limits above, instead of simply allowing overexposure to reach the set SNR limits, this will enable dual ISO instead, allowing you to retain full highlight detail (minus dual ISO deficiencies), while still capturing the required SNR in the midtones and/or shadows.



Advanced settings




Exposure target:

  • Where to place the highlights with respect to overexposure.

Allow Clipping:

  • Off:  Only allow overexposure as per the highlight ignore setting.
  • Green Channel:  Ignore the green channel, and calculate exposure settings from the other channels.
  • Any Channel:  Allow some overexposure, over and above the highlight ignore setting, in any channel.

Link to Canon shutter

  • Set the slowest shutter speed AETTR is allowed to use, via Canon exposure settings.
  • This allows you to set the slowest shutter speed with the scroll wheel/main dial.

Show metered areas

  • Show where the white point and SNR levels are metered (what exactly is considered highlight, midtone and shadow).
  • Colored zebras represent those areas.

Show debug info

  • For nerds.
#33
Updated: October 3rd, 2013

By now you should have a few video raw files to process. 

If not then make sure you read here:

RAW video & ML -- Beginners Guide and FAQ -- READ FIRST
http://www.magiclantern.fm/forum/index.php?topic=5520.0

--------------------------------
THE ORIGINAL: RAW Video Post processing [Mac/Win/Linux]
http://www.magiclantern.fm/forum/index.php?topic=5404.0

--------------------------------

Remember: RAW means that your Picture Profiles have no effect on the final video colors, contrast, sharpness, etc.  All of this should be adjusted in Post-processing.

-------------------------------

Nice Tut for those interested in Davinci Resolve and AE workflow: http://www.youtube.com/watch?v=jASBwVSOlXkh

--------------------------------


Step 1  EXTRACTING THE DNG FRAMES


The RAW video files cannot currently be processed directly by any video editor.  Each RAW file encapsulates the frames in DNG format so we need to extract these frames first:

1.1 Please download the RAw2dng.exe  application for windows.

HERE: http://acoutts.com/a1ex/raw2dng.exe

Instructions
: In Windows just drag and drop the RAW video files to this exe and it will extract the dng frames in the directory where the RAw2dng.exe file is located.

If your card is formatted inside the camera, it will have FAT32 format in which case the RAW files will be split in 4GB chunks.  You will need to join them in the following manner before you process them with Raw2dng.exe

1. Rename the files as  file1.raw  file2.raw .. etc
Use command line:
copy/b file1.raw+file2.raw+.... filenew.raw

or ..

1a. Rename files as file.001, file.002
Download file joiner splitter such as FFSJ v 3.3
http://www.softpedia.com/get/File-managers/File-Splitter-and-Joiner.shtml

2. Extract DNG with latest RAw2dng.exe
here: HERE: http://acoutts.com/a1ex/raw2dng.exe

If you format your card outside the camera to Exfat then the camera will record files larger than 4GB.  These files can be processed with the latest Raw2dng.exe  See link above


Nice new apps for Windows being developed for automatic batch processes here:

RAWanizer - windows batch generation of proxy files from RAW
http://www.magiclantern.fm/forum/index.php?topic=5557.0

RAW2DNG BATCHelor 1.1 Beta
http://www.magiclantern.fm/forum/index.php?topic=5645.msg39772#msg39772



1.1a For MAC users follow instructions here:


raw2dng.app 0.7 Osx GUI development, bugs and updates
HERE: http://www.magiclantern.fm/forum/index.php?topic=5508.0

Other technical details about DNG:

Install Adobe DNG Codec 2.0 (Needed to see thumb images in windows)
http://www.adobe.com/support/downloads/detail.jsp?ftpID=5495

DNG = Digital Negative is a lossless raw image format which was developed by Adobe.
http://en.wikipedia.org/wiki/Digital_Negative

In case you are wondering this is NOT CinemaDNG format
HERE: http://download.macromedia.com/pub/labs/cinemadng/cinemadng_p1_spec_091009.pdf

How to view DNG thumbnails in Windows:

Good review and methods here:
http://photographylife.com/how-to-view-dng-thumbnails-in-windows

I use FastPictureViewer Codec Pack, which is great!
http://www.fastpictureviewer.com/codecs/

A complete library of DNG support here:
http://www.barrypearson.co.uk/articles/dng/products_y7.htm#converters


Step 2 MAKING NECESSARY ADJUSTMENTS TO DNG FRAMES

Now you should have you RAW file broken into its individual frames. 

The next step is make some corrections of White Balance and Tint.  To do this you will need some software that can open the DNG files and allows to make the required adjustments.

The most powerful tool to do this is ACR (Adobe Camera Raw) which is a plug-in for Photoshop.  If you have it then:

2.1. Open all the files at once, if you computer does not have enough memory or speed you will have to note all of the settings and apply to smaller sets of images.   

2.2. On the left side of ACR you will see a thumbnail of all of the opened images.   Click on the first image on the left side and then click on Select All

2.3. Set the White Balance according to the scene, this is a subjective step but you can have ACR set it for you if you in Auto mode or simply choose from the options in the drop down menu which mostly represents the scene in which the video was recorded.  For example you can set it to Daylight, and this will adjust the WB=5500 and the Tint=10

2.4. Make sure that your settings in the Basic configuration are not moved from zero adjustment.  Read carefully Technical Note 1 below step 2.6

2.5. On the bottom left side of ACR click on the Save Images button where you need to make some selections as to where to save the files, the type of image format you want to save, and the quality of such format.  The  selection will depend on what type of software you have available for converting these images into a video file, and  the desired quality of the final process.  If you are not sure, select jpeg format and  the highest quality to make sure we do not lose any details i.e. Quality=12

2.6. Finally click on Save and then on Done.  The ACR will work converting these DNG frames to your selected directory.

TECHINICAL NOTE 1 :
In ACR 7.1 do not abuse the highlight, shadow recovery sliders because this might bring flickering from frame to frame. 
In ACR 6.7 do not move the fill light and recovery sliders.


If you experience flickering then start backing off on ACR (BASIC) adjustment sliders.  I have successfully used the sliders in ACR 7.1 Tone Curve for highlight and shadow control without experiencing any flickering.

Follow this issue here:
Preventing Color/Luma Shifting When Processing DNGs in Adobe Camera RAW
http://www.magiclantern.fm/forum/index.php?topic=5710.0

Other software that can open and adjust DNGs:

1. UFRAW
2. Lightroom 4.2
3. Dcraw
4...


Step 3  MAKING A VIDEO OUT OF THE NEW FRAMES (JPG, TIFF, DNG)


Most video production software will allow to import the frames and turn them into a video.   Usually it is referred as opening an image sequence and it allows to import all of the frames at once into an editable video.

One of the most powerful and free video editors is called VirtualDub which is able to import the frames, do some fancy editing, and save it.

Originally it could only save in avi format but now there are plug-ins can be added to save in other formats.

Download here: www.virtualdub.org/index

Here is quick how to:

Open VirtualDub
File Open
Select Image Sequence from selection type
Click on Video and Frame Rate
Change Frame Rate to (fps): 29.97 Click OK (Must match your RAW video settings)
Again Click on Video and then Compression
Select new Codec Like CineForm (Must install this one)
Click OK
Click File Save AS AVI

To install CineForm codec you must install GoPro Cineform Studio.  This codec will produce great results but if you want the full version which allows for greater color depth and 2K to 4K frame sizes you will have to purchase their Cineform Studio Premium program.

More details about this here:
Cineform Studio (free) 1080p transcoding issues:
http://www.magiclantern.fm/forum/index.php?topic=2695.0

That is it! 

Now you have RAW video converted to and AVI file.  Note that you may not be able to play this in a slow PC.  This AVI file will be very large and require very high bitrates which may not be compatible with older PCs.  For this reason I have mention above that you should install a compression codec to reduce the size of the file and make it a bit more readable in slow hard drives.

The beauty of this process is that it is conserving much of the original data contained in the RAW files.  If you compress this video to other formats like mpeg1 you will lose all of the great details provided by RAW video recording.

This is where all of the more advanced video post processing methods flourish in an effort to pass all of the great detail, and color depth to the viewers.  At this point one has to consider who are the viewers and the platforms available for viewing so the optimal choice of software and workflow will vary greatly.

Here you can find more discussions regarding more advanced workflows:

RAW Video Post processing [Mac/Win/Linux]
http://www.magiclantern.fm/forum/index.php?topic=5404.0


-------------------

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

If you have a question, don't post it! First use the search function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.
#34
General Chat / The Magic Lantern Storm
May 22, 2013, 11:05:43 PM


A whole new world of opportunities are up for grabs!

We Love the ML team.

Thanks from 300,000 users!


-----------

OMG!  I cannot keep up with all the new developments that are going on!!!!!!!!!!!!

RAW VIDEO
DIGITAL CROPPED RAW VIDEO
60 FPS RAW VIDEO

.. and if that was not enough!

Auto Exposure to the Right
Timelaspse with Auto Exposure to the Right

.. and if that was not enough! For those who do not have fast CF card or are stuck with SD cards...

Attempting to develop lower 10 bit and 12 bit RAW  VIDEO CAPABILITIES

Magic Lantern (RAW) Video format v2.0

Dual ISO - massive dynamic range improvement...

RAW support to just about all of the DSLR that canon makes!



CONGRATULATIONS GUYS!!!!  WE LOVE YOU ALL!!!   ;D ;D ;D ;D ;D ;D
#35
Due to the stretching we need some strange frame heights to come up with 16:9 aspect ratio.  here is a list:

To Get :            need  this
----------------------------------
720x400 =>      720x 239 (240 stretches to 400 when multiplied by 1.67 aprox)
960x540 =>      960x322
1280x720 =>    1280x430
1320x740 =>    1320x442
1440x810 =>    1440x484
1600x900 =>    1600x538
1720x960 =>    1720x574
1880x1060 =>   1880x633
1920x1080 =>   1920x645

Ok so if the stretch ratio (1.674) does not change then we could make use of 239, 322,430, 442, 484, 538, 574, 633, and 645 pixels for frame height.

I tried adding this myself but got errors so we need, when time is available, to have some help from our DEVs.

Thanks for all of this wonderful stuff you are providing us.
#36
Currently the 60fps does not support zoom function.  Would this be possible?  It would be awesome.
Thanks
#37
The 60 fps RAW files are squashed and need to be stretched by 167% for correct aspect ratio.  This causes some loss of detail as shown below.

Can this be improved?  The RAW streched image is better than canons 1280 60 fps but not as good as pure raw at 1280x740.
See below image:



---------------

For more info on 60 fps RAW :

http://www.magiclantern.fm/forum/index.php?topic=5472.0
#38
First get the dng frames out of raw video file using raw2dng.exe
Get it here: http://acoutts.com/a1ex/raw2dng.exe

Now that we have a squashed 60 fps image sequence (dng) that needs to be stretched by 1.674 factor in the vertical direction...

What is the best workflow?

If you want to know how to get 60fps RAW video go here:
http://www.magiclantern.fm/forum/index.php?topic=5472.0

To begin with we could aim for HD 720-60p (1280x720, 59,940 fps)

To get this we need to begin with a vertical height of 720/1.674 = 430. 

So we should nicely to our DEVs if this makes sense and to add a new Height selection of 430 pix to our already huge selection.

Currently we could start with 1280x480 stretch it to = 1280x803 and crop it back to 1280x720.

-------------------------

My quick and dirty workflow goes:

Open DNG with ACR and correct for White Balance, Tint and anything else required except height.
Export from ACR to jpg at Quality 12
Open VirtualDub  (Free, Excellent, and Powerful Software)
File Open
Select Image Sequence from selection type
Go to Video and Filters
Select Add
Pick the resize filter (Must install filter packages)
Enter the Absolute pixels : 1280x720
Click OK and OK to accept the filter
Again Click on Video and Frame Rate
Change Frame Rate to (fps): 59.94 Click OK
Again Click on Video and Compression
Select new Codec Like CineForm (Must install this one)
Click OK
Click File Save AS AVI

That is it!

This should render a very smooth replay in Windows Media Player.

Optional Workflow with Vegas Pro12:

Import the sequence to Vegas Pro 12
Set Project Properties at HD 720-60p
Open Sequence of Jpg
Click on the Event/Pan Crop Tool on the Video
Deselect the Lock Aspect Ratio
Click on Position Height and change it to 720
Close PAN/Crop tool
Click on the Event FX tool on the Video
Select Sony Deform Plug-inn
Select the Compress Vertically Preset
Slide the Amount slider till the frame fills.  Aprox -053
Close the FX window
Now you can Render it as avi with Template HD 720-60p YUV
For better replay performance change the codec to something like Lagarith or CineForm

I am not an expert so I invite the AE experts and such to show their Workflow since mine is very rudimentary.
#39
This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView



Original post:
Updated Jan 04 2014

[b][size=14pt]Welcome to the world of RAW recording with Magic Lantern.[/size][/b]

Installing ML can be summarized in three steps, keep this in mind in case you are getting lost in the process!

1. You need to set the bootflag in your camera.  Only for 5D3 this cannot be undone so read here:
http://www.magiclantern.fm/forum/index.php?topic=7125.0

2. You need to make your SD card (or CF for some cameras) bootable with EOScard

3. Only then you can use the nightly builds.

-------------------------------------------------------------------------------------------

[color=blue][size=14pt][b]Quick Setup Guide for 5D3[/b][/size]

Here is a simplified procedure that works.

1. Format card on PC ([u]must use card reader[/u]) and then format on Camera.
2. Put card back on card reader (PC) and copy the fir file to the card root directory.  Get it here: http://a1ex.magiclantern.fm/bleeding-edge/5D3/5D3-113-bootflag.fir
3. Put card back on Camera and go to the Firmaware update section (Canon Menu) do an update with the 5D3-113-bootflag.fir  Make sure you have a full battery, a dead battery during firmware update could be a disaster.
4. Once the firmware update is finished you have set the bootflag on your camera. 
5. Put card back on the card reader
6. Use EOScard to make the card bootable, which is the main reason to use EOScard.exe
    get it here: http://pel.hu/eoscard/  or  http://pel.bencemate.com/eoscard/
7. [u]Make sure EOS Develop box is selected, Bootdisk box is selected and simply click on Save.  If all goes well the card will be made bootable and a "write sucessfull" message will appear on the bottom of EOScard.[/u]
8. EOScard sometimes fails to get the latest ML files so go to http://builds.magiclantern.fm/#/
and get the latest ML files.  If EOScard put some files in my card I would erase them and replace them with the latest compiles.

I only use EOScard to make my card bootable and use it only when I do a PC format of my card (almost never).  To stay up to date with the latest builds just go to  http://builds.magiclantern.fm/#/  and get the latest files.  Make sure you replace all of the existing files in your card so I always delete the existing files before I put the new ones.  Do not mix new files with old ML files.  Always replace the complete set, except for some modules that can be added separately.

Remember that if you format your card on the PC then the card has to be run through EOScard to make it bootable.

The EOScard added function of downloading the latest compile is a perk but apparently it does not always work and sometimes you end up putting the wrong ML files in your card.  In this case make sure you delete those files and get the latest.

[/color]
----------------------------------------------------------------

For the latest raw video capabilities of all supported cameras go here:
http://www.magiclantern.fm/forum/index.php?topic=6215.0

The best suited cameras for RAW are the ones that have CF cards which are faster then SD cards.  Other cameras with SD can also work but the RAW video is limited to lower frame size since the SD controller can only transfer at something like  30 to 40 MB/s depending on model.

5D3 is best and working very good.  Continuous recording at 1920x1080 up to 29.97 fps[color=red]  (Bootflag cannot be undone, this increases wake up time from 0.2 to 2 sec)[/color]
http://www.magiclantern.fm/forum/index.php?topic=7125.0
5D2 work in progress, continuous recording at 1880x940 at 24p or 1600x900 at 29.97 fps
7D work in progress, continuous 1728x972 24p.
6D work in progress, continuous recording at1840x460 at 24 fps
60D work in progress, continuous recording at 1584x1058 at 24fps
50D work in progress, continuous recording at 1584x1058 at 24fps
700D (T5i) work in progress, continuous recording 1280x720 24 fps.
650D (T4i) work in progress, continuous recording 1280x720 24 fps.
600D (T3i) work in progress, continuous recording 950x540 24 fps.
500D (T2i) work in progress, continuous recording 950x540? 24 fps.
550 & 550D work in progress, continuous recording 950x540 24 fps.
EOSM making progress 1280x720 at 24 fps.

Note: [b]... and audio recording with RAW video is not available yet.[/b]

There are two types of installs, one for ML proven cameras and the other for new cameras.

[b][size=14pt]Install for ML proven cameras:[/size][/b]

These are: 550D (T1i), 60D, 600D (T3i), 50D, 500D (T2i) , 5D2, and 1100D.

[b]Install Guide[/b] <--- this will install basic ML in your camera and you must do this first.
Here: http://wiki.magiclantern.fm/install

If you want to try the latest  features (including RAW) for these cameras then:
[b]Nightly Builds - try the very latest stuff:[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=3072.0

To try the new RAW development delete the old files from your card and copy the new ones obtained from above.
Direct link to the new builds:  http://builds.magiclantern.fm/#/

[b]IMPORTANT: Get a card reader, without it you will not be able to install ML.[/b]


[b][size=14pt]Install for other cameras:[/size][/b]

[b]IMPORTANT: Get a card reader, without it you will not be able to install ML.[/b]

[b]How to install Magic Lantern on 5D Mark III[/b]

A Tutorial linked by a1ex below in this thread for 5D Mark III

[youtube]http://www.youtube.com/watch?v=d7pn5Q6wNMY[/youtube]
Many thanks to Charlie Loc (correct spelling?) for creating it.

[b]Also here is a quick guide just for the 5D Mark III[/b]
http://www.cinema5d.com/news/?p=17898

If you do not want to set the bootflag then try the simple install (Not for RAW)
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0
Make sure you are running Canon Firmware 1.1.3.

[b]HOW TO: A guide to installing ML on the 7D with recent features:[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=7464.0
Make sure you are running Canon Firmware 2.03

[b]Raw video on 50D[/b]
http://www.magiclantern.fm/forum/index.php?topic=5586.0

[b]60D RAW video - it's working !![/b]
http://www.magiclantern.fm/forum/index.php?topic=5653.0

[b]Magic Lantern for 6D | Dev kit releas[/b]ed:
HERE: http://www.magiclantern.fm/forum/index.php?topic=3904.0
Make sure you are running Canon 1.1.3

and also here:

6D - Install guide and raw shooting.
http://www.magiclantern.fm/forum/index.php?topic=5530.0

[b]Canon 700D / T5i[/b]
http://www.magiclantern.fm/forum/index.php?topic=5951.0

[b]Canon 650D [Status: Hello, world!]:[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=3697.0

[b]EOS M ** Alpha 1 ** [FIXED][DOWNLOAD]:[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=3648.0
[u][b]
OTHER CAMERAS:[/b][/u]

[b]Canon 1100D / T3:[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=1009.0
[b]
Canon 5D Classic Firmware ** Beta 4 **[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=1010.0
[b]
Canon 40D[/b]
http://www.magiclantern.fm/forum/index.php?topic=1452.0

-------------------------------------


[b]FINALLY INSTALLATION OF RAW VIDEO[/b]

[u][b]OK!  Now you should be familiar with ML for your camera and what you can do.  If you are one of the lucky owners of the DSLR that can do RAW Video then continue...[/b][/u]

Now that you have Magic Lantern installed and running on your camera, you are then ready to install RAW video.  The development team are continually making changes to the software and these changes compiled into builds which you can use to update your camera.

By now you know there is an autoexec.bin file in your card.  This file contains all the instruction on how your camera will behave and each new build will include all of those changes in this autoexec.bin file. 

So updating your camera software, in most cases, will require that you obtain the new autoexec.bin file to replace the old one.  In the case of the RAW video there are some additional files required, these files are inside the [b]Modules[/b] directory. 

Here is a directory structure in a typical ML install:

Root Directory:

DCIM (Canon DIR)
MiSC (Canon DIR)
ML (DIR)
autoexec.bin
xxx-bootflag.fir

Please note that the xxx-bootflag.fir  only needed to set the bootflag on the camera.  After this time this fir file can be deleted.


The first two are directories for Canon files.

[b]ML[/b] is the main directory for Magic Lantern and inside this directory there is typically up to the following directories:

cropmks (DIR)
data (DIR)
doc (DIR)
LOGS (DIR)
[b]MODULES[/b] (DIR)
scripts (DIR)
SETTINGS (DIR)

So the other update is inside [b]MODULES[/b] where you will find the following files:

magic.sym
raw_rec.mo
[u][b]

SUMMARY: [/b][/u]
1. Obtain new files for: autoexec.bin, magic.sym, raw_rec.mo
2. Replace the old files in the card.  That is all!!
3. Usually it is a good idea to delete the MAGIC.CFG file which is in the SETTINGS directory to start saving new configuration settings which may apply to the new (updated) changes.

[u][b]SPECIAL CASES:  [/b][/u]
On the newer cameras there are new files that are uses instead or in addition to the autoexec.bin files. 

[b]5D3[/b] If you installed the Alpha 3 + DevKit you will also have this special file which will need to be downloaded:
5D3-113-bootflag.fir  This file will set the boot flag when the camera boots from the card containing the file.
[b]
This flag cannot be undone yet so may want to read here first: [/b]
http://www.magiclantern.fm/forum/index.php?topic=5810.msg42407#msg42407

This file is found at the bottom of the instructions where it says [color=red]FOR DEVELOPERS ONLY[/color]  here :

Download ML for 5D Mark III - Alpha 3.
http://www.magiclantern.fm/forum/index.php?topic=2602.0

Put camera in [b]M[/b] mode

Put the 5D3-113-bootflag.fir flag on the root directory (SD card) and let your camera boot.  Wait until the update is finished.

[b]Now make your card bootable[/b]

Use EOS card 1.2 to make your card bootable.

Go to: http://wiki.magiclantern.fm/install

Scroll to:

[b]Installing Magic Lantern on other cards[/b]

Download EOScard from the link and make your card bootable.  You have to install EOScard and select the card that you want to make bootable.

Now  put all of the ML required files, your cam will boot with ML installed!

If you downloaded  [b]ML for 5D Mark III - Alpha 3[/b], you should have most of the standard files needed to make up the ML directory structure.  To this structure you need to add all the newest RAW files as previously noted.  You will find a link to the newest files below..

[b]
Special note on to use EOScard Utility:[/b]

This is the way to set the flag on the card:

When you use EOScard make sure that:
1. You have the necesary files in the SD card: *.fir file (only if you need to set the bootflag on that camera; this process to be done only once), autoexec.bin file, plus the ML directory.
2. The Utility recognizes the card by identifiying it in the box next to Refresh.
3. You select the EOS_DEVELOP  check box
4. You select the BOOTDISK check box
5. Under Content, make sure EOScard recognizes: DCIM folder, autoexec.bin file, ML folder, and if required (to enable the boot flag on camera) the fir file.  When EOScard recognizes all of those files it should give you a check mark or something like that.
6. Press the Save button.
7. Look on the bottom of EOScard and should give you a confirmation that the card was written, ie. write successful.

I recently read about another situations with the newer EOScard utility in which the automatic function brought the files to the SD via internet connection.  I am not familiar with this function but Pelican seems to more about it since he created EOScard utility.  Anyway the issue was that EOScard utility had downloaded some files plus there were already some files in the card, the user noticed that in the fir file area it showed like 2 files so the user had to select the correct fir file for the EOScard utility to properly prepare the card! One of the files was for Mac and the other was for windows.

Also on most cameras, except 5D3, if you enable the camera bootflag via firmware update, and then do it again you will be disabling the bootflag. In the 5D3 you cannot disable the camera bootfalg.  It is and ON-OFF process, so if you have a camera working and set the camera flag using the *.fir file you will be disabling the flag in the camera and ML wont start.

So remember to make a card bootable use EOScard utility, and to set the camera flag use *.fir file and do the firmware update.

[b]And... always use a card reader if you want this to work properly![/b]

----------

[u][b]Where to get the latest builds for RAW:[/b][/u]

[u][b]If you are a programmer then you can read to learn how to compile all this stuff by-yourself:[/b][/u]

[b]Getting started with development[/b]
Here:  http://www.magiclantern.fm/forum/index.php?topic=991.0
Here: http://www.magiclantern.fm/forum/index.php?topic=2899.0

[u][b]OTHER IMPORTANT LINKS FOR RAW VIDEO[/b][/u]

[u][b]To help the DEVS[/b][/u] and everybody it would be a good idea if specific RAW video issues are discussed in a [b]separate thread based on the camera under discussion.[/b]

5D3  [b]Uncompressed 14-bit RAW video testing - 5D Mark III[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  [b]Raw video on 5DMK2[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D [b]Uncompressed 600D Raw Video[/b] 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

[b]6D + Raw thread (with instillation guide)[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

[b]60D RAW video - it's working !!![/b]
http://www.magiclantern.fm/forum/index.php?topic=5653.0

[b]Canon 650D [Status: Hello, world!][/b]
http://www.magiclantern.fm/forum/index.php?topic=3697.0

[b]Raw video on 50d and 40d[/b]
http://www.magiclantern.fm/forum/index.php?topic=5586.msg38778;topicseen#msg38778

--------------------

[b]
[u]OTHER USEFUL LINKS:[/u][/b]

[b]Magic Lantern Best Practices:[/b]
http://www.magiclantern.fm/bestpractices

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Canon Firmware 1.1.3 or any fw for any camera (Windows version) for sure:[/b]
HERE: http://pel.hu/eoscard/

[b]Where to get Canon Firmware 1.1.3 (Mac version) for sure:[/b]
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Compiled Nightly Builds?[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=3072.0

All questions regarding [b]RAW VIDEO POST PROCESSING on any OS[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding [b]RAW_REC MODULE COMPILATION/INSTALLATION/USAGE[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

[b]Supported 1000x CF cards for continuous RAW recording[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0

*************************


Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.
[b]
If you have a question, don't post it[/b]! First use the search function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.

[size=8pt][color=blue]Remove obsolete links to nightly builds and fixed remaining link to point to official nightly builds  // Audionut[/color][/size]
#40
If you are looking for speed, then enable the Hack3D to get over the hump.  This feature seems to give a little extra writing speed boost so that some Height x Width selections might work.

PENALTY:  No LiveView update. 

Here are my findings for 5D3 with Lexar 32GB 1000X

1920x1152 at 24 fps FROM 600 FRAMES TO 4GB
1920x1152 at 25 fps FROM 376 FRAMES TO 4GB
1920X960 at 29.97 fps FROM 261 FRAMES TO ALMOST 1161 FRAMES(3.7 GB)
1880x960 at 29.97 fps FROM 128 FRAMES TO 360 <<<< - IT APPEARS SLOWER! why?
1600X672 AT 50 FPS FROM 230 FRAMES TO 600
1440X540 AT 60 FPS FROM 391 FRAMES TO 4 GB

----------------------------------------

OTHER HELPFUL LINKS:

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a separate thread based on the camera under discussion.

5D3  Uncompressed 14-bit RAW video testing - 5D Mark III
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  Raw video on 5DMK2
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D Uncompressed 600D Raw Video 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

650D I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?

6D I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?
Any other ones??  Anyone care to propose so I can update this message?

--------------------

How to install Magic Lantern on 5D Mark III
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

Where to get Canon Firmware 1.1.3 for sure:
HERE: http://pel.hu/eoscard/

How to install Magic Lantern on 5D Mark III
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

Where to get Canon Firmware 1.1.3 for sure:
HERE: http://pel.hu/eoscard/

Where to get Compiled Nightly Builds?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0

All questions regarding RAW VIDEO POST PROCESSING on any OS
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding RAW_REC MODULE COMPILATION/INSTALLATION/USAGE
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

Card benchmark - what's the optimal write buffer size?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

Supported 1000x CF cards for continuous RAW recording
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0
#41
This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView

Updated September 26th 2013

Before you try this you may want load up on the most recent compile!!

Nightly builds with Raw recording support
http://www.magiclantern.fm/forum/index.php?topic=6362.0

1. Make sure you have CF card selected.
2. Switch your camera to video mode (flip the video lever), focus your subject and adjust for the scene .  Works in M, AV, TV modes.
3. Select the 60 fps  video specification from Canon Menu by pressing Q button.
4. Use the Joy stick to move and make "blue" the video mode.
5. Scroll through the videos to 1280 60fps.
6. Press half shutter to return to Live View.
  [b]If you have not loaded the raw_rec module then:[/b]
7. Press trash button and go to Modules Tab using your joystick or scroll wheel.   (It is an icon with four little squares)
8. Use the scroll wheel or joystick to highlight the raw_rec module and then press the set button to enable it.
9. Reboot the camera, then press trash button and if the module loaded correctly you will see it in bright white with a green dot on the left.
10. Scroll to Movie Tab with the small scroll wheel or joystick and then scroll to [b]Raw video[/b] with the large scroll wheel or joystick.  The Raw Video should be OFF.
11. Enable RAW video by pressing the Set Button.  Look at the video settings and also look near the bottom of the screen for information about CF speed requirements to meet current fps and frame size.
12. Press Q and Set to chose the appropriate Resolution, or use the little scroll wheel to scroll from available options.  If your card is not fast enough then select acceptable resolutions.  Remember to look at the bottom of the screen to see how resolution affect card speed requirements.
13. Scroll to Aspect ratio 16:9 is the default.  You can scroll with the little wheel or press Set to change it.  By changing the aspect ratio the camera chooses an appropriate video height.  Some heights are not the most common ones but these combinations offer better writing speeds.  You may have to crop your video in post.
[color=red]14. (AUDIO NOT AVAILABLE RIGHT NOW, USE EXTERNAL RECORDER-->)[/color] [s]If you want to record audio (wav file to SD card) scroll to Sound and select Separate [b]WAV[/b], or [b]sync beep[/b], or [b]OFF[/b][/s]
14. [b]Preview: Auto[/b].  Press [b]Set [/b]to change it to: Canon, [b]ML Grayscale[/b], [b]Hacked [/b](see note 6)
15. [b]Digital dolly: OFF[/b] On to allow the recording area to scroll from left-to-right or up-down during cropped video or when recording at smaller resolutions then max (1920x1080)  Use the Joystick to control the direction of the scroll.
16. [b]Frame skipping: OFF[/b] To continue recording even if skips frames then scroll to and select [b]Allow[/b].
17. [b]Card warm-up: OFF[/b] Press set to select a warm-up file size when camera boots.  Some speed improvements obtained.
18. [b]Memory hack: OFF[/b]. Press Set to on  This frees up more memory to get extra frames in the buffer.
19. [b]Small hacks: OFF[/b] to improve the use of memory to increase recording buffer.
20.  [b]Playback [/b]  After recording a RAW file you can preview it by coming back to this menu and scroll to Playback selection and pressing [b]Set[/b].
21. Press [b]Q[/b] and then move to [b]Overlay[/b] and set [b]Global Draw[/b] to [b]OFF[/b].  See note 7.
22. To get back to LV just press trash button or half shutter.
22. To start and stop recording press the LV button
[size=12pt][b]
Option for 50 fps recording:[/b][/size]

23. Move to the Movie tab and select FPS override with the scroll wheel.  (see note below)
24. Press the Q button
25. Change the Desired FPS to 50 using the small (top) scroll wheel.
26. Move to the Optimize for with the large scroll wheel.
27. Change to Exact FPS with the small scroll wheel.
28. Press the Q button and then press the Set button (on the center of the large scroll wheel) to enable FPS override
29. Now FPS should read 50.

-------------------------------------------

Note 6. [b] Canon [/b]preview is standard full color, [b]ML Grayscale[/b] is in B&W and also shows the video in its final cropped view (used for framing),[b] Hacked[/b] is special fast hack to increase card writing speed at the expense of freezing Live View.

Note 7.  If you set Global Draw OFF you will loose histogram, zebras, etc.  But you will gain speed.  In some cases Global ON is more likely to get pink frames since CPU is working very hard, and also consumes much more power.
----------------------------

[size=12pt][b]VERY IMPORTANT[/b][/size]

Make sure that in Canon Menu:
Image Quality = Raw
Auto Lighting Optimizer = OFF
Long exp. noise reduction = OFF
High ISO spee NR = OFF
Higthlight tone priority = OFF
Multiple Exposure = Disable
HDR Mode = Disagle HDR
----------------------

[size=12pt][b]Other technical aspects:[/b][/size]

The frames recorded at 60 fps are squashed and need to be corrected in post.  This is a Canon sensor property that cannot be changed.  Probably to sample the sensor at 60 fps it can only be done skipping some lines therefore the image is squashed, not at full resolution, and with aliasing.
The height stretch factor is approximately = 1.67
That means 1440x480 should be stretched to 1440x790 to look correct.

On a 1000X 32gb Lexar can get:
1440x480 at 60 fps --> When stretch it becomes 1440x803 very close to 16:9
1600x540 at 50 fps (using FPS Override) --> stretced to 1140x903

-----------------------------------------

Quick and dirty Post Processing Guide:

[b]60fps -- RAW video Post-Processing Workflow[/b]
http://www.magiclantern.fm/forum/index.php?topic=5538.0


Since the quality of RAW is so good, maybe these videos could upres to ???x???.  I have not tested this yet!

-----------------------------------

Here you can see some frame grabs from standard RAW video compared with 60 fps (stretched) and Canons 60 fps.
The RAW version is an improvement over Canons but not as good as standard RAW.
So the stretching does some damage!!!  I dont know if it is possible to get 60fps non squashed video!!

[img]http://s20.postimg.org/mhnxnv8vh/RAW_vs_Streched_vs_MOV.jpg[/img]


----------------


OTHER HELPFUL LINKS:

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a separate thread based on the camera under discussion.

5D3  Uncompressed 14-bit RAW video testing - 5D Mark III
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  Raw video on 5DMK2
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D Uncompressed 600D Raw Video
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

6D 6D + Raw thread (with instillation guide)
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

650D I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?


--------------------

Magic Lantern Best Practices:
http://www.magiclantern.fm/bestpractices

How to install Magic Lantern on 5D Mark III
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

Where to get Canon Firmware 1.1.3 (Windows version)  for sure:
HERE: http://pel.hu/eoscard/

Where to get Canon Firmware 1.1.3 (Mac version) for sure:
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

How to install Magic Lantern on 5D Mark III
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

Where to get Canon Firmware 1.1.3 for sure:
HERE: http://pel.hu/eoscard/

Where to get Compiled Nightly Builds?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0

All questions regarding RAW VIDEO POST PROCESSING on any OS
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding RAW_REC MODULE COMPILATION/INSTALLATION/USAGE
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

Card benchmark - what's the optimal write buffer size?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

Supported 1000x CF cards for continuous RAW recording
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0

*************************

PLEASE !!! PLEASE!!

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

If you have a question, don't post it! First use the search function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.
#42
This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView

Updated September 26th 2013

1. Make sure you have CF selected.  Need a 1000x CF card to get 1920x1080 at 24 fps.
2. Switch your camera to Video Mode (flip the video lever to the left), focus your subject and adjust for the scene .  Works in M, AV, TV modes.
3. Press Q and select the 1920 @ 30 fps  video specification from Canon Menu.
4. Use the Joy stick to move and make "blue" the video mode.
5. Scroll through the videos to [b]1920 30fps[/b].  If you do not use FPS override the camera defaults to Canon settings.  See note 1
6. Press half shutter to return to Live View.
  If you have not loaded the raw_rec module then:
7. Press trash button and go to Modules Tab using your joystick or scroll wheel.   (It is an icon with four little squares)
8. Use the scroll wheel or joystick to highlight the raw_rec module and then press the set button to enable it.
9. Reboot the camera, then press trash button and if the module loaded correctly you will see it in bright white with a green dot on the left.
10. Scroll to [b]Movie[/b] with the large scroll wheel and then to [b]Raw video[/b] with the small scroll wheel.
11. Enable RAW video by pressing the [b]Set [/b]Button.  Look at the video settings and also look near the bottom of the screen for information about CF speed requirements to meet current fps and frame size.
12. Press [b]Q[/b] and [b]Set[/b] to chose the appropriate [b]Resolution[/b], or use the little scroll wheel to scroll from available options.  If your card is not fast enough then select acceptable resolutions.  Remember to look at the bottom of the screen to see how resolution affect card speed requirements.
13. Scroll to [b]Aspect ratio[/b] [b]16:9[/b] is the default.  You can scroll with the little wheel or press [b]Set[/b] to change it.  By changing the aspect ratio the camera chooses an appropriate video height.  Some heights are not the most common ones but these combinations offer better writing speeds.  You may have to crop your video in post.
[color=red]14. (AUDIO NOT AVAILABLE RIGHT NOW, USE EXTERNAL RECORDER-->)[/color] [s]If you want to record audio (wav file to SD card) scroll to Sound and select Separate [b]WAV[/b], or [b]sync beep[/b], or [b]OFF[/b][/s]
14. [b]Preview: Auto[/b].  Press [b]Set [/b]to change it to: Canon, [b]ML Grayscale[/b], [b]Hacked [/b](see note 6)
15. [b]Digital dolly: OFF[/b] On to allow the recording area to scroll from left-to-right or up-down during cropped video or when recording at smaller resolutions then 1920x1080.  Use the Joystick to control the direction of the scroll.
16. [b]Frame skipping: OFF[/b] To continue recording even if skips frames then scroll to and select [b]Allow[/b].
17. [b]Card warm-up: OFF[/b] Press set to select a warm-up file size when camera boots.  Some speed improvements obtained.
18. [b]Memory hack: OFF[/b]. Press Set to on  This frees up more memory to get extra frames in the buffer.
19. [b]Small hacks: OFF[/b] to improve the use of memory to increase recording buffer.
20.  Next option, [b]Playback [/b]  After recording a RAW file you can preview it by coming back to this menu and scroll to Playback selection and pressing [b]Set[/b].
21. Press [b]Q[/b] and then move to [b]Overlay[/b] and set [b]Global Draw[/b] to [b]OFF[/b].  See note 7.
22. To get back to LV just press trash button or half shutter.
23. To start and stop recording press the LV button

[size=12pt][b]OPTION FOR 24/25 FPS RECORDING:[/b][/size]

24.  Move to the [b]Movie[/b] tab and select [b]FPS override[/b] with the scroll wheel.  (see note below)
25. Press the [b]Q[/b] button
26. Change the [b]Desired FPS[/b] to 23.97 using the small (top) scroll wheel.
27. Move to the [b]Optimize for[/b] with the large scroll wheel.
28. Change to [b]Exact FPS[/b] with the small scroll wheel.
29. Press the Q button and then press the Set button (on the center of the large scroll wheel) to enable FPS override
30. Now FPS should read 23.97.

Note 1: It is best to set the Canon video format to 1920 30 fps.  When you do this and set the FPS Override to 24 fps you will have very little variation in fps when you switch from zoom mode to standard mode.

Note 6. [b] Canon [/b]preview is standard full color, [b]ML Grayscale[/b] is in B&W and also shows the video in its final cropped view (used for framing),[b] Hacked[/b] is special fast hack to increase card writing speed at the expense of freezing Live View.

Note 7.  If you set Global Draw OFF you will loose histogram, zebras, etc.  But you will gain speed.  In some cases Global ON is more likely to get pick frames since CPU is working very hard, and also consumes much more power.
--------------------

[size=12pt][b]
For further RAW Video Post processing:[/b][/size]

The RAW files will be found inside the DCIM folder.

RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

[Mac/Win/Linux] go here: http://www.magiclantern.fm/forum/index.php?topic=5404.0[/b]

---------------------------


[b][size=12pt]Latest findings to prevent frame drops:[/size][/b]
[u]
You should check that in Canon Menu:[/u]
Image Quality = Raw
Auto Lighting Optimizer = OFF
Long exp. noise reduction = OFF
High ISO speed NR = OFF
Highlight tone priority = OFF
Multiple Exposure = Disable
HDR Mode = Disable HDR

---------------------------


[size=12pt][b]OTHER RECORDING OPTIONS:[/b][/size]

If you want to use [b]60 fps[/b] then read here for more detailed settings:
http://www.magiclantern.fm/forum/index.php?topic=5472.0

If you want do a [b]1:1 Digital Video Crop[/b] with your zoom button then go here for detail instructions:
http://www.magiclantern.fm/forum/index.php?topic=5441.0

---------------------------------------

[u][b]
OTHER HELPFUL LINKS:[/b][/u]

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a [b]separate thread based on the camera under discussion.[/b]

5D3  [b]Uncompressed 14-bit RAW video testing - 5D Mark III[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  [b]Raw video on 5DMK2[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D [b]Uncompressed 600D Raw Video[/b] 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

[b]6D[/b] 6[b]D + Raw thread (with instillation guide)[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

[b]650D[/b] I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?


--------------------

[b]Magic Lantern Best Practices:[/b]
http://www.magiclantern.fm/bestpractices

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Canon Firmware 1.1.3 (Windows version)  for sure:[/b]
HERE: http://pel.hu/eoscard/

[b]Where to get Canon Firmware 1.1.3 (Mac version) for sure:[/b]
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

[b]Where to get Compiled Nightly Builds?[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0

All questions regarding [b]RAW VIDEO POST PROCESSING on any OS[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding [b]RAW_REC MODULE COMPILATION/INSTALLATION/USAGE[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

[b]Card benchmark - what's the optimal write buffer size[/b]?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

[b]Supported 1000x CF cards for continuous RAW recording[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0


-------------------

[b]PLEASE!!  PLEASE!![/b]

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

[b]If you have a question, don't post it![/b] First use the search function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.
#43
This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView

Update: September 26th 2013

[b]Digital Cropped Video is now possible and it is equivalent to putting a 3X multiplier on your lens without increasing the f stop (That is Magic, only with Magic Lantern)  ;D:[/b]

The Recording function is only available at 5X zoom, 10X is only used for precise focusing.

1. Make sure you have CF selected. 
2. Switch your camera to Video Mode (flip the video lever to the left). Works in M, AV, TV modes.
3. Press Q and select the 1920 @ 30 fps  video specification from Canon Menu.
4. Use the Joy stick to move and make "blue" the video mode.
5. Scroll through the videos to [b]1920 30fps[/b].  If you do not use FPS override the camera defaults to Canon settings.  See note 1
6. Press half shutter to return to Live View.
7. Press the zoom button to 5X or 10X and focus your subject in LiveView.  (If you skip this step you will not get the 3x higher resolutions)
  If you have not loaded the raw_rec module then:
8. Press trash button and go to Modules Tab using your joystick or scroll wheel.   (It is an icon with four little squares)
9. Use the scroll wheel or joystick to highlight the raw_rec module and then press the set button to enable it.
10. Reboot the camera, then press trash button and if the module loaded correctly you will see it in bright white with a green dot on the left.
11. Scroll to [b]Movie[/b] with the large scroll wheel and then to [b]Raw video[/b] with the small scroll wheel.
12. Enable RAW video by pressing the [b]Set [/b]Button.  Look at the video settings and also look near the bottom of the screen for information about CF speed requirements to meet current fps and frame size.
13. Press [b]Q[/b] and [b]Set[/b] to chose the appropriate [b]Resolution[/b], or use the little scroll wheel to scroll from available options.  If your card is not fast enough then select acceptable resolutions.  Remember to look at the bottom of the screen to see how resolution affect card speed requirements.
[b]Note: If you pressed the zoom button in step 7 you can select higher resolutions such as: 2048x1152, 2240x1260, 2560x1320, 2880x1320, and 3584x1320[/b]
14. Scroll to [b]Aspect ratio[/b] [b]16:9[/b] is the default.  You can scroll with the little wheel or press [b]Set[/b] to change it.  By changing the aspect ratio the camera chooses an appropriate video height.  Some heights are not the most common ones but these combinations offer better writing speeds.  You may have to crop your video in post.
15. (NOT AVAILABLE RIGHT NOW-->) If you want to record audio (wav file to SD card) scroll to Sound and select Separate [b]WAV[/b], or [b]sync beep[/b], or [b]OFF[/b]
16. [b]Preview: Auto[/b].  Press [b]Set [/b]to change it to: Canon, [b]ML Grayscale[/b], [b]Hacked [/b](see note 6)
17. [b]Digital dolly: OFF[/b] On to allow the recording area to scroll from left-to-right or up-down during cropped video or when recording at smaller resolutions then max (1920x1080)  Use the Joystick to control the direction of the scroll.
18. [b]Frame skipping: OFF[/b] To continue recording even if skips frames then scroll to and select [b]Allow[/b].
19. [b]Card warm-up: OFF[/b] Press set to select a warm-up file size when camera boots.  Some speed improvements obtained.
20. [b]Memory hack: OFF[/b]. Press Set to on  This frees up more memory to get extra frames in the buffer.
21. [b]Small hacks: OFF[/b] to improve the use of memory to increase recording buffer.
22.  Next option, [b]Playback [/b]  After recording a RAW file you can preview it by coming back to this menu and scroll to Playback selection and pressing [b]Set[/b].
23. Press [b]Q[/b] and then move to [b]Overlay[/b] and set [b]Global Draw[/b] to [b]OFF[/b].  See note 7.
24. To get back to LV just press trash button or half shutter.
25. To start and stop recording press the LV button

[size=12pt][b]OPTION FOR 24/25 FPS RECORDING:[/b][/size]

26.  Move to the [b]Movie[/b] tab and select [b]FPS override[/b] with the scroll wheel.  (see note 2 below)
27. Press the [b]Q[/b] button
28. Change the [b]Desired FPS[/b] to 23.97 using the small (top) scroll wheel.
29. Move to the [b]Optimize for[/b] with the large scroll wheel.
30. Change to [b]Exact FPS[/b] with the small scroll wheel.
31. Press the Q button and then press the Set button (on the center of the large scroll wheel) to enable FPS override
32. Now FPS should read 23.97.
[b]
Technical notes:[/b]

Note 1: It is best to set the Canon video format to 1920 30 fps and then to set the fps speed via FPS Override.  When you do this you will have very little variation in fps when you switch from zoom mode to standard mode.

Note 2: f you do not use FPS override the default fps for 5X zoom mode is 29.97, so if you want to record at a different fps you better set it here.  Additionally it is always best to use FPS override to eliminate damaged frames.

Note 6. [b] Canon [/b]preview is standard full color, [b]ML Grayscale[/b] is in B&W and also shows the video in its final cropped view (used for framing),[b] Hacked[/b] is special fast hack to increase card writing speed at the expense of freezing Live View.

Note 7.  If you set Global Draw ON you will have a focus box that helps you frame the video properly for all resolutions,  The drawback of this method is that it is only in black and white and sometimes it slows down LV.

[b]Hot Tip: If you press the info button, it will disable Global Draw and you will clearly see the subject, but the framing is off so use the framing with GD ON.  After you press info button you will have to press it three times to scroll back to the gray framing overlay.[/b]

If you set Global Draw OFF in zoom mode you get full color and real-time update.

------------------------

[size=12pt][b]VERY IMPORTANT[/b][/size]

Make sure that in Canon Menu:
Image Quality = Raw (5D3, 650D,  ....)
Image Quality = jpeg (...., ....)
Auto Lighting Optimizer = OFF
Long exp. noise reduction = OFF
High ISO speed NR = OFF
Highlight tone priority = OFF
Multiple Exposure = Disable
HDR Mode = Disable HDR

and.. to get the zoom function to work in LV you need to "Enable" Live View shooting  and also AF mode set to "Live mode", of course this is done in Canon menu.  check your camera specifics to the zoom function working in Live View
----------------------

[size=12pt][b]
For further RAW Video Post processing:[/b][/size]

The RAW files will be recorded on the DCIM folder. 

RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

[Mac/Win/Linux] go here: http://www.magiclantern.fm/forum/index.php?topic=5404.0[/b]

------------------

[u][b]
OTHER HELPFUL LINKS:[/b][/u]

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a [b]separate thread based on the camera under discussion.[/b]

5D3  [b]Uncompressed 14-bit RAW video testing - 5D Mark III[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  [b]Raw video on 5DMK2[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D [b]Uncompressed 600D Raw Video[/b] 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

[b]6D[/b] 6[b]D + Raw thread (with instillation guide)[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

[b]650D[/b] I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?


--------------------

[b]Magic Lantern Best Practices:[/b]
http://www.magiclantern.fm/bestpractices

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Canon Firmware 1.1.3 (Windows version)  for sure:[/b]
HERE: http://pel.hu/eoscard/

[b]Where to get Canon Firmware 1.1.3 (Mac version) for sure:[/b]
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

[b]Where to get Compiled Nightly Builds?[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0
14-Bit RAW video Builds for 5D2 : http://www.magiclantern.fm/forum/index.php?topic=5533.0

All questions regarding [b]RAW VIDEO POST PROCESSING on any OS[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding [b]RAW_REC MODULE COMPILATION/INSTALLATION/USAGE[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

[b]Card benchmark - what's the optimal write buffer size[/b]?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

[b]Supported 1000x CF cards for continuous RAW recording[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0

-------------------

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

[b]If you have a question, don't post it![/b] First use the [b]search[/b] function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.
#44
Quote from: 1% on May 06, 2013, 04:59:39 PM
Main repo has it, just enable TCC and modules.

Thanks but I dont know which modules to enable.  I found a dir with a few modules including lv_rec.
Also dont know how to enable TCC. 

Any post that has these instructions?
#45
General Development / DNG vs RAW Hi ISO Test
May 02, 2013, 08:31:59 PM
Update:  NOTE: This results may be wrong!  I now believe the difference is due to shutter speed of "silent picture".  In this case the DNG photos would have been taken at shutter speed of 1/31 which would be approximate equivalent of 30 fps while the RAW image was taken a 1/160 s.  In this manner the silent picture mode would have allowed more light to the sensor and produce less noise.  I am not sure what happen to ISO but probably it is a case of ETTR which improve the image IQ.  I originally thought that the "silent picture" shutter speed was determined by my setting Tv but I think this is set in the FPS override module.. 

Maybe Alex can confirm my erroneous findings?? 

-----------------------------------

Camera 5D3, Lens Canon 300 mm f4  IS L
Here are the test subjects at  1.6s, f4, ISO 125


I did not see any important differences at low ISO so this comparison is skipped but...

Now at 1/160, f4 ISO 25000
Processed with PS no editing, sharpening 0, cropped and resized to 640 pix width.
Tested full RAW (5760x3840) vs DNG (3592x1320) vs DNG (1928x1285)



Same as above with post to remove noise, etc,



Conclusion: DNG is superior in color, noise, and sharpness! Wow!!!!!

Is there a possibility that this process could be implemented outside LV to obtain cleaner images at full resolution at high ISO in DNG?  Then 5D3 IQ = 1DX!
#46
Unable to compile due to the following errors:

../../src/flexinfo.c: In function 'info_load_config':
../../src/flexinfo.c:621:5: warning: passing argument 2 of 'FIO_GetFileSize' from incompatible pointer type [enabled by default]
../../src/dryos.h:523:1: note: expected 'unsigned int *' but argument is of type 'uint32_t *'
../../src/flexinfo.c: In function 'info_resolve_color':
../../src/flexinfo.c:1422:14: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
../../src/flexinfo.c:1426:14: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
../../src/flexinfo.c: In function 'info_print_icon':
../../src/flexinfo.c:1539:13: warning: unused variable 'fgcolor' [-Wunused-variable]
../../src/flexinfo.c:1538:13: warning: unused variable 'bgcolor' [-Wunused-variable]
[ CC       ]   ico.o
[ CC       ]   console.o
[ CC       ]   clibrary.o
[ CC       ]   expression.o
[ CC       ]   heap.o
[ CC       ]   include.o
[ CC       ]   lex.o
[ CC       ]   parse.o
[ CC       ]   platform.o
[ CC       ]   table.o
[ CC       ]   type.o
[ CC       ]   variable.o
[ CC       ]   library_ml.o
[ CC       ]   platform_ml.o
[ CC       ]   picoc.o
[ CC       ]   chdk-gui_script.o
[ AR       ]   lib_a-setjmp.o
[ AR       ]   libstdio.a
[ LD       ]   magiclantern
tskmon.o: In function `tskmon_init':
tskmon.c:(.text+0x458): undefined reference to `pre_isr_hook'
tskmon.c:(.text+0x460): undefined reference to `post_isr_hook'
collect2: ld returned 1 exit status
../../Makefile.inc:330: recipe for target `magiclantern' failed
make[1]: *** [magiclantern] Error 1
make[1]: se sale del directorio `/home/PH/magic-lantern/platform/5D3.113'
Makefile:70: recipe for target `5D3' failed
make: *** [5D3] Error 2
#47
General Help Q&A / Bulb ramping Trouble Shooting
January 17, 2013, 04:33:30 PM
I am new to this technique and would like to learn and analyze the results of the BRAMP.LOG file.

I have imported the LOGS into excel using fixed width as separators of the fields.

Could someone help me explanain of the following items:

1.  Luma curve: cached: 11,16,25,43,78,128,184,226,248,254,254
     (I assume that is the set of points used in the internal calibration S curve, in which case it only represents the x-value but no y-value is given in this curve.  I assume y value is stored somewhere.)

2.  Reference level: 69 at 65-th percentile  (I assume this is the percentile I selected from the 1st image I took and to be used for the future analysis)

3. Now there is a set of parameters for each image taken that need clarification:

First Column:   Image Number
Luma = xxx  (Luma calculated from new image, how is this calculated)
rounderr= xx (Dont know)
y= xx (Dont know)
r= xx (Donk know)
e=-xx (Dont know)
==> harsh/soft
f= xx
e= -xx (Same as above)
u=- xx
shutter= xx (Image Shutter speed value)
iso= xx (image ISO value)

Thanks
Renato
#48
General Chat / Digital Video Crop Mode
December 05, 2012, 03:33:35 PM
I use 5D mark III for bird videos and photography.  One thing I noticed is that when I am focusing my video in Live Mode I use the zoom button (5x-10X) and get fantastic resolution to properly focus on the fine details of the birds.  Unfortunately all that resolution of the sensor does not translate to the resolution of the video.  Now I have learned that inferior models such as t3i allow you to actually record the zoom LiveView details.  This would be a GOD SENT tool for wildlife videographers if it could be implemented to the 5D Mark III.  I think canon would boost their  camera sells if they allowed this digital zoom option to be customized ie. 2x, 3x, 4x, ... 10x and to record the high definition video.

I suppose Canon would prefer to sell you a 600 mm lens of $10,000 rather then allow to make use of the cropped mode sensor to get the same results!! 

So the question arises, since I cannot record cropped video in my 5D3 to test:

Assume I put a 50mm f1.4 lens on my 5D3.  Will the cropped video say at 3x on a 5D3, which is equivalent to 1920x1280, be better or worse than using a 3X lens, which for a full frame camera would be 150 mm?

My guess is that the cropped video might be better since there is no downsizing from the sensor full resolution to the 1920x1280.  Of course that would assume that the 150 mm lens is of prime quality.   

I would love to use my 300 mm prime lens with digital zoom of 3x to capture fine wildlife videos without spending a fortune...
Maybe the great effort to do this with ML would be worth lots of money to some videographers like me.  Hint, hint .. big fat donations!