How to record: -- RAW Digital Cropped Video 30/24fps on 5D3 & others--

Started by RenatoPhoto, May 16, 2013, 04:29:01 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

RenatoPhoto

This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView

Update: September 26th 2013

[b]Digital Cropped Video is now possible and it is equivalent to putting a 3X multiplier on your lens without increasing the f stop (That is Magic, only with Magic Lantern)  ;D:[/b]

The Recording function is only available at 5X zoom, 10X is only used for precise focusing.

1. Make sure you have CF selected. 
2. Switch your camera to Video Mode (flip the video lever to the left). Works in M, AV, TV modes.
3. Press Q and select the 1920 @ 30 fps  video specification from Canon Menu.
4. Use the Joy stick to move and make "blue" the video mode.
5. Scroll through the videos to [b]1920 30fps[/b].  If you do not use FPS override the camera defaults to Canon settings.  See note 1
6. Press half shutter to return to Live View.
7. Press the zoom button to 5X or 10X and focus your subject in LiveView.  (If you skip this step you will not get the 3x higher resolutions)
  If you have not loaded the raw_rec module then:
8. Press trash button and go to Modules Tab using your joystick or scroll wheel.   (It is an icon with four little squares)
9. Use the scroll wheel or joystick to highlight the raw_rec module and then press the set button to enable it.
10. Reboot the camera, then press trash button and if the module loaded correctly you will see it in bright white with a green dot on the left.
11. Scroll to [b]Movie[/b] with the large scroll wheel and then to [b]Raw video[/b] with the small scroll wheel.
12. Enable RAW video by pressing the [b]Set [/b]Button.  Look at the video settings and also look near the bottom of the screen for information about CF speed requirements to meet current fps and frame size.
13. Press [b]Q[/b] and [b]Set[/b] to chose the appropriate [b]Resolution[/b], or use the little scroll wheel to scroll from available options.  If your card is not fast enough then select acceptable resolutions.  Remember to look at the bottom of the screen to see how resolution affect card speed requirements.
[b]Note: If you pressed the zoom button in step 7 you can select higher resolutions such as: 2048x1152, 2240x1260, 2560x1320, 2880x1320, and 3584x1320[/b]
14. Scroll to [b]Aspect ratio[/b] [b]16:9[/b] is the default.  You can scroll with the little wheel or press [b]Set[/b] to change it.  By changing the aspect ratio the camera chooses an appropriate video height.  Some heights are not the most common ones but these combinations offer better writing speeds.  You may have to crop your video in post.
15. (NOT AVAILABLE RIGHT NOW-->) If you want to record audio (wav file to SD card) scroll to Sound and select Separate [b]WAV[/b], or [b]sync beep[/b], or [b]OFF[/b]
16. [b]Preview: Auto[/b].  Press [b]Set [/b]to change it to: Canon, [b]ML Grayscale[/b], [b]Hacked [/b](see note 6)
17. [b]Digital dolly: OFF[/b] On to allow the recording area to scroll from left-to-right or up-down during cropped video or when recording at smaller resolutions then max (1920x1080)  Use the Joystick to control the direction of the scroll.
18. [b]Frame skipping: OFF[/b] To continue recording even if skips frames then scroll to and select [b]Allow[/b].
19. [b]Card warm-up: OFF[/b] Press set to select a warm-up file size when camera boots.  Some speed improvements obtained.
20. [b]Memory hack: OFF[/b]. Press Set to on  This frees up more memory to get extra frames in the buffer.
21. [b]Small hacks: OFF[/b] to improve the use of memory to increase recording buffer.
22.  Next option, [b]Playback [/b]  After recording a RAW file you can preview it by coming back to this menu and scroll to Playback selection and pressing [b]Set[/b].
23. Press [b]Q[/b] and then move to [b]Overlay[/b] and set [b]Global Draw[/b] to [b]OFF[/b].  See note 7.
24. To get back to LV just press trash button or half shutter.
25. To start and stop recording press the LV button

[size=12pt][b]OPTION FOR 24/25 FPS RECORDING:[/b][/size]

26.  Move to the [b]Movie[/b] tab and select [b]FPS override[/b] with the scroll wheel.  (see note 2 below)
27. Press the [b]Q[/b] button
28. Change the [b]Desired FPS[/b] to 23.97 using the small (top) scroll wheel.
29. Move to the [b]Optimize for[/b] with the large scroll wheel.
30. Change to [b]Exact FPS[/b] with the small scroll wheel.
31. Press the Q button and then press the Set button (on the center of the large scroll wheel) to enable FPS override
32. Now FPS should read 23.97.
[b]
Technical notes:[/b]

Note 1: It is best to set the Canon video format to 1920 30 fps and then to set the fps speed via FPS Override.  When you do this you will have very little variation in fps when you switch from zoom mode to standard mode.

Note 2: f you do not use FPS override the default fps for 5X zoom mode is 29.97, so if you want to record at a different fps you better set it here.  Additionally it is always best to use FPS override to eliminate damaged frames.

Note 6. [b] Canon [/b]preview is standard full color, [b]ML Grayscale[/b] is in B&W and also shows the video in its final cropped view (used for framing),[b] Hacked[/b] is special fast hack to increase card writing speed at the expense of freezing Live View.

Note 7.  If you set Global Draw ON you will have a focus box that helps you frame the video properly for all resolutions,  The drawback of this method is that it is only in black and white and sometimes it slows down LV.

[b]Hot Tip: If you press the info button, it will disable Global Draw and you will clearly see the subject, but the framing is off so use the framing with GD ON.  After you press info button you will have to press it three times to scroll back to the gray framing overlay.[/b]

If you set Global Draw OFF in zoom mode you get full color and real-time update.

------------------------

[size=12pt][b]VERY IMPORTANT[/b][/size]

Make sure that in Canon Menu:
Image Quality = Raw (5D3, 650D,  ....)
Image Quality = jpeg (...., ....)
Auto Lighting Optimizer = OFF
Long exp. noise reduction = OFF
High ISO speed NR = OFF
Highlight tone priority = OFF
Multiple Exposure = Disable
HDR Mode = Disable HDR

and.. to get the zoom function to work in LV you need to "Enable" Live View shooting  and also AF mode set to "Live mode", of course this is done in Canon menu.  check your camera specifics to the zoom function working in Live View
----------------------

[size=12pt][b]
For further RAW Video Post processing:[/b][/size]

The RAW files will be recorded on the DCIM folder. 

RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

[Mac/Win/Linux] go here: http://www.magiclantern.fm/forum/index.php?topic=5404.0[/b]

------------------

[u][b]
OTHER HELPFUL LINKS:[/b][/u]

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a [b]separate thread based on the camera under discussion.[/b]

5D3  [b]Uncompressed 14-bit RAW video testing - 5D Mark III[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  [b]Raw video on 5DMK2[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D [b]Uncompressed 600D Raw Video[/b] 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

[b]6D[/b] 6[b]D + Raw thread (with instillation guide)[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

[b]650D[/b] I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?


--------------------

[b]Magic Lantern Best Practices:[/b]
http://www.magiclantern.fm/bestpractices

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Canon Firmware 1.1.3 (Windows version)  for sure:[/b]
HERE: http://pel.hu/eoscard/

[b]Where to get Canon Firmware 1.1.3 (Mac version) for sure:[/b]
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

[b]Where to get Compiled Nightly Builds?[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0
14-Bit RAW video Builds for 5D2 : http://www.magiclantern.fm/forum/index.php?topic=5533.0

All questions regarding [b]RAW VIDEO POST PROCESSING on any OS[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding [b]RAW_REC MODULE COMPILATION/INSTALLATION/USAGE[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

[b]Card benchmark - what's the optimal write buffer size[/b]?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

[b]Supported 1000x CF cards for continuous RAW recording[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0

-------------------

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

[b]If you have a question, don't post it![/b] First use the [b]search[/b] function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

N.Mendes

Really Awesome!!

Is the loss of detail too noticeable? For me, that is where the 4k makes sense..


peter.scharff

This is more closer to the 10x canon zoom magnification you see when previewing a zoom .............. happy days !!!

Now being able to select different zoom/crop ratios via a menu would be the next huge step for ML :D

RenatoPhoto

The beauty of this video is that there is ZERO loss of detail when compared to a photo taken a full resolution.  Of course the photo covers the entire size of the sensor 5760x3840 pix while the video is just a small portion of the sensor in my case I am generating a video of 1920x1080 pix.   There is no down-sampling of the sensor so the image is a 1:1 crop.

Since we are using 1920 pix out of the 5760 pix (width) the zoom factor is 5760/1920 = 3X.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Audionut

Quote from: RenatoPhoto on May 16, 2013, 04:29:01 AM
3. Press the joystick 17 times to the left and 8 to the top to center the focusing box on the new cropped frame.  (Hopefully this can be automated some day if there is an automated selection for Cropped Video settings.

It would be preferable to use the center of the sensor (center of the lens) for crop, as the best piece of the glass is it's center.

For instance just taking vignetting into account, the top left corner could be a stop less (EV) then the center.  Currently in crop mode, that would mean using ISO 200 instead of ISO 100 for instance.

There's sharpness (loss) and chromatic aberration problems also.

1%

I think you can use any party of the zoom box.. if you move it too far it can get some of the black borders.

scrivoluce

Dumb question, once that we know to handle 3x data crop by the sensor, is it possible to send back them to the H264 encoder!? This will enable 600d like feature.....

RenatoPhoto

FRAME COMPARISON FOR DIGITAL CROPPED VIDEO

Canon 5D3 / Canon EF 50mm  1:1.8
Manual Mode 1/125, f1.8, ISO 100, WB 5500k

Setup


Here is the process I used:

1. Took a photo a full RAW
2. Took a video at 1920x1080 24 fps with Neutral Picture Style
3. Took a standard RAW video at 1920x1080 24 fps
5. Took a Zoomed RAW video at 5X at 1920x1080 24 fps (Cropped Digital Video)
6. Extracted the dng frames from the RAW videos
7. Extracted the tiff frames from the MOV (canon) video
8. Processed all frames in photoshop with following corrections:

DNG:
1. Changed WB to 5500 and +6 Tint since this was the values from the CR2 file
2. Took all sharpening out
3. Opened to Photoshop and adjusted Levels
4. Sharpened with Unsharp mask 50%, radious 0.9 pix, Threshold 0

CR2:
1. Took all sharpening out
3. Opened to Photoshop and adjusted Levels
3. Opened to Photoshop and adjusted Levels
4. Sharpened with Unsharp mask 50%, radious 0.9 pix, Threshold 0

Tiff:
1. Opened to Photoshop and adjusted Levels
2. Opened to Photoshop and adjusted Levels
3. Sharpened with Unsharp mask 50%, radious 0.9 pix, Threshold 0

Final Comparison

CR2 versus Zoomed DNG


In the photo above it is clear that the detail of the zoomed RAW video is equal to the detail in the CR2 image.

Tiff versus no zoom DNG


In the above photo it is clear that the detail, dynamic range, noise, and sharpening characteristics of the normal RAW video is superior than MOV.



http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X


RenatoPhoto

Just noticed that with the new commit the zoomed video in LV mode at 5X is in gray color.  When I press record it gets fixed.  The 10X zoom is ok.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

a1ex

It's a preview so you can frame with it... but it's hard to make it color and real-time on the ARM cpu

jordancolburn

This might not be relevant, since I've only tested on the 600d, but would it be possible to just overlay a white framed box before recording for framing?  That plus popping into the 10x zoom would be enough to get focus and framing.  (The build I had only seemed to add the white frame box after recording was started unless I missed a feature?).

jordancolburn

NM, just downloaded a newer build and it already functions the way I wanted.  Thanks ML team for putting in features before I even know I want them!  1st raw, now mindreading.  Big week.

peter_f

Hi, not sure if developments are being made in this area. I believe I have the latest built from here:

https://drive.google.com/folderview?id=0B7QlH_BH2m32TWVYWnVrck83RjQ&usp=sharing

How come the video being recorded is shifted to the side vs the picture shown in live view? Is there a way to film what is shown in live view?

a1ex

x5 zoom with globaldraw on has correct framing.

RenatoPhoto

I think he is asking why the cropped video (5X) only covers the top-left side of the sensor rather than the center.  I dont know the answer to this question.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

a1ex


a1ex


1%

Per frame size should be visible... some frame sizes write faster than others it seems.

a1ex

Shouldn't happen after the 32MB fix, according to the huge benchmarks.

vstrglv

Please help!
There is no crop video on my 5D3. I have used RenatoPhoto's instruction from the first post. When i press 5x zoom first and then LV button - nothing happens, but zero size raw file. If i press LV button first- recording starts, but when I press 5x zoom - recording stops. Raw settings 1920x1080. I have tried several later builds.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

RenatoPhoto

Quote from: a1ex on May 19, 2013, 07:20:48 PM
Here's a nice calculator: http://www.slashcam.de/tools/ml-raw-calc.html

Worth displaying those in ML menu?

Current commit shows in RAW video screen the MB/s the fps and the colors according to card speed.  Maybe add aspect ratio?

My preference would be for cam to test the card and to set the recommended frame sizes according to fps.  For example for:

1000X Lexar I get.

23.97 fps 1920x1080
25 fps 1880 x 1080
29.97 fps 1720x960
50 fps 1600x540
60 fps 1440 x480

So when I put this card, the cam tests if new card is inserted.
Now I should have the existing method of frame selection AND a new method, like Canons selection

1920x1080 at 23.97 fps
1880x1080 at 25 fps
1720x960 at 29.97 fps
1600x540 at 50 fps
1440x480 at 60 fps

If this method is used then FPS override should be automatic to simplify this video selection menu.

Any way this post should probably go on Feature Request.  Sorry if this is not possible.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Quote from: vstrglv on May 19, 2013, 09:14:44 PM
Please help!
There is no crop video on my 5D3. I have used RenatoPhoto's instruction from the first post. When i press 5x zoom first and then LV button - nothing happens, but zero size raw file. If i press LV button first- recording starts, but when I press 5x zoom - recording stops. Raw settings 1920x1080. I have tried several later builds.

Go to ML menu move to Help and post version
Also Card Spec .
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vstrglv

ML v.2013May19.503113
Build on 2013-05-19 23:12:36
I have tried May15, May17 also
CF - Transend 600 32Gb
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

RenatoPhoto

May want to try this:  http://www.magiclantern.fm/forum/index.php?topic=5413.0

Also check your SD card file structure to make sure you have all files look here:
www.magiclantern.fm/forum/index.php?topic=5520.0

Must have the MODULES directory with the three files as noted above
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X