Messages

5D3 with 1000x 32 gig Lexar .  New Compile TEST

New compile gives me problems with producing cropped digital video.  If I record at 5X or 10X zoom, the RAW video can be separated by raw2dng.exe converter but the dng files cannot be opened in ACR 7.1 photoshop.

Also sometimes the raw2dng.exe converter does not put out any frames.

Also there is always a new RAW video on the card at 0Bites.

Maybe it is my compile or maybe not!

The regular video (not zoomed) is ok and I can now record to 1920x1152 without frame drops so the module clears the buffer a bit faster.

The new start - stop method works fine!

Anyway you guys are awesome!!

This original post is now outdated.

See:
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
MLV Lite
Crop mode recording (crop_rec.mo) (1:1, RAW/H.264, 25/30/50/60 fps)
crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView

Code Select Expand

Update: September 26th 2013

[b]Digital Cropped Video is now possible and it is equivalent to putting a 3X multiplier on your lens without increasing the f stop (That is Magic, only with Magic Lantern)  ;D:[/b]

The Recording function is only available at 5X zoom, 10X is only used for precise focusing.

1. Make sure you have CF selected. 
2. Switch your camera to Video Mode (flip the video lever to the left). Works in M, AV, TV modes.
3. Press Q and select the 1920 @ 30 fps  video specification from Canon Menu.
4. Use the Joy stick to move and make "blue" the video mode.
5. Scroll through the videos to [b]1920 30fps[/b].  If you do not use FPS override the camera defaults to Canon settings.  See note 1
6. Press half shutter to return to Live View.
7. Press the zoom button to 5X or 10X and focus your subject in LiveView.  (If you skip this step you will not get the 3x higher resolutions)
  If you have not loaded the raw_rec module then:
8. Press trash button and go to Modules Tab using your joystick or scroll wheel.   (It is an icon with four little squares)
9. Use the scroll wheel or joystick to highlight the raw_rec module and then press the set button to enable it.
10. Reboot the camera, then press trash button and if the module loaded correctly you will see it in bright white with a green dot on the left.
11. Scroll to [b]Movie[/b] with the large scroll wheel and then to [b]Raw video[/b] with the small scroll wheel.
12. Enable RAW video by pressing the [b]Set [/b]Button.  Look at the video settings and also look near the bottom of the screen for information about CF speed requirements to meet current fps and frame size.
13. Press [b]Q[/b] and [b]Set[/b] to chose the appropriate [b]Resolution[/b], or use the little scroll wheel to scroll from available options.  If your card is not fast enough then select acceptable resolutions.  Remember to look at the bottom of the screen to see how resolution affect card speed requirements.
[b]Note: If you pressed the zoom button in step 7 you can select higher resolutions such as: 2048x1152, 2240x1260, 2560x1320, 2880x1320, and 3584x1320[/b]
14. Scroll to [b]Aspect ratio[/b] [b]16:9[/b] is the default.  You can scroll with the little wheel or press [b]Set[/b] to change it.  By changing the aspect ratio the camera chooses an appropriate video height.  Some heights are not the most common ones but these combinations offer better writing speeds.  You may have to crop your video in post.
15. (NOT AVAILABLE RIGHT NOW-->) If you want to record audio (wav file to SD card) scroll to Sound and select Separate [b]WAV[/b], or [b]sync beep[/b], or [b]OFF[/b]
16. [b]Preview: Auto[/b].  Press [b]Set [/b]to change it to: Canon, [b]ML Grayscale[/b], [b]Hacked [/b](see note 6)
17. [b]Digital dolly: OFF[/b] On to allow the recording area to scroll from left-to-right or up-down during cropped video or when recording at smaller resolutions then max (1920x1080)  Use the Joystick to control the direction of the scroll.
18. [b]Frame skipping: OFF[/b] To continue recording even if skips frames then scroll to and select [b]Allow[/b].
19. [b]Card warm-up: OFF[/b] Press set to select a warm-up file size when camera boots.  Some speed improvements obtained.
20. [b]Memory hack: OFF[/b]. Press Set to on  This frees up more memory to get extra frames in the buffer.
21. [b]Small hacks: OFF[/b] to improve the use of memory to increase recording buffer.
22.  Next option, [b]Playback [/b]  After recording a RAW file you can preview it by coming back to this menu and scroll to Playback selection and pressing [b]Set[/b].
23. Press [b]Q[/b] and then move to [b]Overlay[/b] and set [b]Global Draw[/b] to [b]OFF[/b].  See note 7.
24. To get back to LV just press trash button or half shutter.
25. To start and stop recording press the LV button

[size=12pt][b]OPTION FOR 24/25 FPS RECORDING:[/b][/size]

26.  Move to the [b]Movie[/b] tab and select [b]FPS override[/b] with the scroll wheel.  (see note 2 below)
27. Press the [b]Q[/b] button
28. Change the [b]Desired FPS[/b] to 23.97 using the small (top) scroll wheel.
29. Move to the [b]Optimize for[/b] with the large scroll wheel.
30. Change to [b]Exact FPS[/b] with the small scroll wheel.
31. Press the Q button and then press the Set button (on the center of the large scroll wheel) to enable FPS override
32. Now FPS should read 23.97.
[b]
Technical notes:[/b]

Note 1: It is best to set the Canon video format to 1920 30 fps and then to set the fps speed via FPS Override.  When you do this you will have very little variation in fps when you switch from zoom mode to standard mode.

Note 2: f you do not use FPS override the default fps for 5X zoom mode is 29.97, so if you want to record at a different fps you better set it here.  Additionally it is always best to use FPS override to eliminate damaged frames.

Note 6. [b] Canon [/b]preview is standard full color, [b]ML Grayscale[/b] is in B&W and also shows the video in its final cropped view (used for framing),[b] Hacked[/b] is special fast hack to increase card writing speed at the expense of freezing Live View.

Note 7.  If you set Global Draw ON you will have a focus box that helps you frame the video properly for all resolutions,  The drawback of this method is that it is only in black and white and sometimes it slows down LV.

[b]Hot Tip: If you press the info button, it will disable Global Draw and you will clearly see the subject, but the framing is off so use the framing with GD ON.  After you press info button you will have to press it three times to scroll back to the gray framing overlay.[/b]

If you set Global Draw OFF in zoom mode you get full color and real-time update.

------------------------

[size=12pt][b]VERY IMPORTANT[/b][/size]

Make sure that in Canon Menu:
Image Quality = Raw (5D3, 650D,  ....)
Image Quality = jpeg (...., ....)
Auto Lighting Optimizer = OFF
Long exp. noise reduction = OFF
High ISO speed NR = OFF
Highlight tone priority = OFF
Multiple Exposure = Disable
HDR Mode = Disable HDR

and.. to get the zoom function to work in LV you need to "Enable" Live View shooting  and also AF mode set to "Live mode", of course this is done in Canon menu.  check your camera specifics to the zoom function working in Live View
----------------------

[size=12pt][b]
For further RAW Video Post processing:[/b][/size]

The RAW files will be recorded on the DCIM folder. 

RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

[Mac/Win/Linux] go here: http://www.magiclantern.fm/forum/index.php?topic=5404.0[/b]

------------------

[u][b]
OTHER HELPFUL LINKS:[/b][/u]

To help the DEVS and everybody it would be a good idea if specific RAW video issues are discussed in a [b]separate thread based on the camera under discussion.[/b]

5D3  [b]Uncompressed 14-bit RAW video testing - 5D Mark III[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5473.0

5D2  [b]Raw video on 5DMK2[/b]
HERE:  http://www.magiclantern.fm/forum/index.php?topic=5419.0

600D [b]Uncompressed 600D Raw Video[/b] 
HERE: http://www.magiclantern.fm/forum/index.php?topic=5494.0

[b]6D[/b] 6[b]D + Raw thread (with instillation guide)[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5530.msg37766#msg37766

[b]650D[/b] I dont see a specific RAW video thread.  Should there be one??  Anyone care to propose so I can update this message?


--------------------

[b]Magic Lantern Best Practices:[/b]
http://www.magiclantern.fm/bestpractices

[b]How to install Magic Lantern on 5D Mark III[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0

[b]Where to get Canon Firmware 1.1.3 (Windows version)  for sure:[/b]
HERE: http://pel.hu/eoscard/

[b]Where to get Canon Firmware 1.1.3 (Mac version) for sure:[/b]
HERE: http://hdslr.com.br/2012/06/20/atualizacao-de-firmware-para-5d-mark-iii-versao-1-1-3/

[b]Where to get Compiled Nightly Builds?[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5413.0
14-Bit RAW video Builds for 5D2 : http://www.magiclantern.fm/forum/index.php?topic=5533.0

All questions regarding [b]RAW VIDEO POST PROCESSING on any OS[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding [b]RAW_REC MODULE COMPILATION/INSTALLATION/USAGE[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5405.0

[b]Card benchmark - what's the optimal write buffer size[/b]?
HERE: http://www.magiclantern.fm/forum/index.php?topic=5471.0

[b]Supported 1000x CF cards for continuous RAW recording[/b]
HERE: http://www.magiclantern.fm/forum/index.php?topic=5391.0

-------------------

Please help us keep our Forum Organized.  We have very specific areas for certain topics so try to conform so that everybody benefits.

[b]If you have a question, don't post it![/b] First use the [b]search[/b] function on the forum (near the top left) and search for the key word.  If you have made a reasonable effort and cannot find an answer then please post your question in the appropriate forum.

[Lexar 32GB]

Latest compile for 5D3 as of now will all new mods tested with Lexar 32GB 1000x

at 24 fps can run for 200 frames with 1920 x1280 !!
at 24 fps can run the full 4GB with 1920 x1152 !!
and of course can run the full 4GB with 1920 x1080 as before.

Test with SanDisk Extreme 32GB 60MB/s

at 24 fps can run 180 frames with 1920x840
at 24 fps can run the full 4GB with 1920x720

Love the new start stop capabilities and the option to stop recording when the buffer is full.

Congratulations Alex and the whole team.  Things are getting better.

A1ex gr3ggo 1% are there plans in implementing this in an alpha? I remember reading that you guys would rather keep making new features than try and put all nightly's in to an alpha, but that was before this raw feature, do you still feel the same way? How much testing needs to be done before you feel comfortable doing something like this?

As always, thank you for your hard work and dedication

I am also concerned about all these versions of ML that may or may not be compiled correctly.  I am not a programer and have spent many hours making my own compile in windows and Gygwin which I finally got it working.  I prefer to compile myself to make sure I have the latest and dont have to ask anyone to do it for me.

IMHO it is best if that the correct compiled version is build into nightly builds, if there is somebody who can dedicate the time to do it.  The other option is to have an up to date instructive on how to compile it so that all interested and apt people can do it.  I could write an instructive for windows (for the 5D3) compile and Cygwin which would be complementary to what PEL did but I don't think I am qualified to do it so it could be misleading.

What worflows do you guys use with the DNG files in Windows environment?

I found out that:

A. Davinci Resolve does not support them.
B. Adobe Speedgrade does not support them.
C. Adobe Lightroom it's ok, but only for simple tasks. For example if you do a highlight recovery and sync all dng files then export to a nle will result in flicker. Probably because although all files have exactly the same settings, internally LR will try to optimise the highlight recovery on a per file basis. (?).
D. AfterEffects through the ACR import. This will have best results. Once you set the interpretation on first file, it's smart enough to keep things consistent for the sequence.  Very, very slow.
E. Cineform Studio/Pro (also the dpx2cf tool) will recognise dng files and convert the sequence to a cineform raw file. You have to fiddle with demosaic (advanced detail 3 seems to work best) and all other settings. The fastest way to preview your movies. Converting it's ultrafast and the result is realtime playable. Fastest way to edit, until now.
F. uffraw batch. Tried once, but slow.

Any other ideas? It seems that cinemadng files and dng files are not *exactly* the same thing and didn't find a way to convert from one to another.

Regards,
Cristian


PS. If the raw2dng could convert directly to cinemadng would be awesome.

I open (all DNGS at once) with Photoshop (ACR 7.1), select all thumbnails on the left first and then correct white balance, tint, and anything else needed like shadows, lumminance, etc.  Then make sure all the thumbnails are selected and and click on "Save Image" on the bottom left, select other options like jpg or tiff.  If you select jpg then set quality to 12 or some artifacts will show.  Saving in tiff works a lot faster but it uses tons of space.  jpg is much slower but uses little space.

Thats the one I'm use, but with 5D2 firmware and autoexec from 14th May.

Since 5D3 firmware won't work on a Mk II...will it?

Sorry I have only for 5D3

I use this one by lourenco and it works.  try it
https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit?usp=sharing

I had similar prob.  Delete the MAGIC.CFG file in the SETTINGS folder under ML.  Put card back and start cam, maybe it will fix it!

After the camera starts push the trash button to bring the ML menue

Is there a way to set the fps besides FPS Override?
Can the shutter speed be set independently or will it be controlled by FPS Override?

I want to know if anyone has been able to compile ML raw_rec module using windows 7 32 bits with Cygwin and gcc 4.7.3

@ lourenco, Thanks for posting the ML files.  I finally got it working..

My test was simple: 5D3, 1000x Lexar 32 GB, 1920x1080 at (aprox) 24fps + 5X ZOOM

The result was continuous recording of RAW DIGITAL CROPPED VIDEO.  I have been wanting this feature on my cam since I found out it was available for the t3i. 

To get it press the zoom button when in live view and then start the raw recorder.  When in LiveView I had to use the joystick to move the center rectangle (thingy) to the left so that the cropped video would be centered.  It is beautiful!

Is there a way to set the fps besides FPS Override?
Can the shutter speed be set independently or will it be controlled by FPS Override?

It is like putting a 3X multiplier on the lens and not loosing any light!!

Good night to all, specially to the great ML team!

I noticed the new make file for raw_rec includes MinGW. 
Which package should be installed under Cgwin for the compiling of raw_rec to work?

Does the vm include the MinGW?

RenatoPhoto, yesterday I tried like hell to make cygwin work. Managed to get a regular compile, but for the module part, didn't work.

So I installed a VirtualMachine (VM VirtualBox), and used the files from nanomad's nightly server. Just download and extract the bigger one. All autoexec compiling will work great.

http://nanomad.magiclantern.fm/Development%20Box/VirtualBox/

Thanks for the info.  I tried the download vm machine but the download kept crashing.  I dont have enough bandwidth for gigs of download so I will have to go somewhere that has huge bandwidth.

For now I will have to use the link to the pre-compiled by lourenco here: http://www.magiclantern.fm/forum/index.php?topic=5247.msg34325#msg34325

Same problem here! help, please! There's not even a mention to module.h in makefile...

I found the module.h but it is in the raw_rec file.  It reads
#include <module.h>

So I gave it a path this way:

#include "../../src/module.h"

so now it goes to the next include with the same error.  So I changed the raw-rec file again.
from:
#include <dryos.h>
to:
#include "../../src/dryos.h"

but this leads to a new error:

$ make
[ CC       ]   raw_rec.o
In file included from ../../src/dryos.h:33:0,
                 from raw_rec.c:21:
../../src/config-defines.h:62:50: fatal error: internals.h: No such file or directory
compilation terminated.
/home/PH/ML/modules/raw_rec/../../Makefile.inc:749: recipe for target `raw_rec.o' failed
make: *** [raw_rec.o] Error 1

So, I dont know what to do.  This is way above my head..

I wonder if the people that have compiled raw_rec module are doing in:

1. windows machine with cygwin?
2. windows machine with VmPlayer?
3. Linux machine?

I am using windows 7 32 bit machine with Cygwin
btw I also tried cloning my directory in case that something messed up but now luck.

I hope someone can clear this for me and others!

Would love to try this stuff but I am hung up of compiling with cygwin under windows here: http://www.magiclantern.fm/forum/index.php?topic=5324.25

If it is not possible then should I download the vm machine?  Would that be only other option?

I am trying to compile latest raw_rec in WINDOWS as noted on the instructions by Alex:

+ * Usage:
1 enable modules in Makefile.user (CONFIG_MODULES = y, CONFIG_TCC = y, CONFIG_PICOC = n, CONFIG_CONSOLE = y)
2 run "make" from modules/raw_rec to compile this module and the DNG converter
3 run "make install" from platform dir to copy the modules on the card
4 from Module menu: Load modules now
5 look in Movie menu

but got the error:

$ make
[ CC       ]   raw_rec.o
raw_rec.c:20:20: fatal error: module.h: No such file or directory
compilation terminated.
/home/PH/magic-lantern/modules/raw_rec/../../Makefile.inc:749: recipe for target `raw_rec.o' failed
make: *** [raw_rec.o] Error 1

Congratulations!
You are the Nobel prize winners for arm development period!
Thanks for your amazing work.
Renato

Thanks but dont know where to put it and what to take out.  Not a programmer. 
Why is the repo not fixed?

Yes in Makefile.user

CONFIG_TCC          = y
CONFIG_MEMCHECK     = y
CONFIG_MODULES      = y

Will have to wait until repo is updated?

Ok, I disabled PicoC in Makefile.user

CONFIG_PICOC = n

.. make clean and make 5D3

It compiled!!!!!!!

No with the last step.

I went to module lv_rec and make but got error, I suppose I should fix this before I compile...

Here is the make at lv_rec directory

H@PH-Laotop ~/magic-lantern/modules/lv_rec
$ make
[ CC       ]   lv_rec.o
lv_rec.c:1:20: fatal error: module.h: No such file or directory
compilation terminated.
/home/PH/magic-lantern/modules/lv_rec/../../Makefile.inc:748: recipe for target `lv_rec.o' failed
make: *** [lv_rec.o] Error 1

Ok done.

Progress made...

New error:

[ LD       ]   magiclantern
tcc-gui.o: In function `handle_picoc_keys':
tcc-gui.c:(.text+0x518): multiple definition of `handle_picoc_keys'
picoc.o:picoc.c:(.text+0x660): first defined here
tcc-gui.o: In function `script_setup_param':
tcc-gui.c:(.text+0x5c8): multiple definition of `script_setup_param'
picoc.o:picoc.c:(.text+0x72c): first defined here
tcc-gui.o: In function `script_reset_params':
tcc-gui.c:(.text+0x620): multiple definition of `script_reset_params'
picoc.o:picoc.c:(.text+0x784): first defined here
tcc-gui.o: In function `script_open_submenu':
tcc-gui.c:(.text+0x9a8): multiple definition of `script_open_submenu'
picoc.o:picoc.c:(.text+0xb0c): first defined here
tcc-gui.o: In function `script_setup_title':
tcc-gui.c:(.text+0xa28): multiple definition of `script_setup_title'
picoc.o:picoc.c:(.text+0xb8c): first defined here
tcc-gui.o: In function `script_key_dequeue':
tcc-gui.c:(.text+0xa5c): multiple definition of `script_key_dequeue'
picoc.o:picoc.c:(.text+0xbc0): first defined here
tcc-gui.o: In function `script_key_enqueue':
tcc-gui.c:(.text+0xa9c): multiple definition of `script_key_enqueue'
picoc.o:picoc.c:(.text+0xc00): first defined here
tcc-gui.o:(.bss+0x4): multiple definition of `script_stop_requested'
picoc.o:(.bss+0x4): first defined here
dietlibc.a(vsscanf.o): In function `vsscanf':
vsscanf.c:(.text+0x5c): warning: warning: the scanf functions add several kilobytes of bloat.
dietlibc.a(sprintf.o): In function `sprintf':
sprintf.c:(.text+0x14): warning: warning: Avoid *sprintf; use *snprintf. It is more secure.
collect2.exe: error: ld returned 1 exit status
../../Makefile.inc:440: recipe for target `magiclantern' failed
make[1]: *** [magiclantern] Error 1
make[1]: se sale del directorio `/home/PH/magic-lantern/platform/5D3.113'
Makefile:70: recipe for target `5D3' failed
make: *** [5D3] Error 2

I'm worried about that people didn't understand the risk of this cutting-edge codes  who is this skill level such as you.
Then, maybe peoples will send canon customer center when their camera is bricked.
Canon need to pay more recovery cost , and canon will start to attack our community IMHO.

hmm, OFF TOPIC SORRY.

Why do you worry about what I do or not do!  I take my own risk, just like everybody else, and I am not stupid just a nob.

So if you want to help that is great, if you dont, then that is great too!  This is a free world and free software which by the way I contributed economically.

If you want to discuss abut risk and what Canon will do then open another thread.  This thread is about help required compiling with TCC.

Hurray!  Looks like it compiled.  I suppose the only way to know if to put in the card and try it!

Thanks for the time you take to help with this issue.  I really appreciated and I assume that this will have to be take care at some point so that other people using windows compiler will have to resolve in order to get some of these TCC module options.  So I hope that the time spent fixing this will help someone else too.

I made the changes as sugguested. 
Here is a portion of the Makefile in TCC directory:

include $(TOP)/../Makefile.user.default
-include $(TOP)/../Makefile.user
CC=../../arm-toolchain473/bin/arm-none-eabi-gcc-4.7.3.exe

After make clean and make 5D3 now a new error shows up:

make -C ../../tcc
make[2]: se ingresa al directorio `/home/PH/magic-lantern/tcc'
../../../arm-toolchain473/bin/arm-none-eabi-ar rcs libtcc.a libtcc.o tccpp.o tccgen.o tccelf.o tccasm.o tccrun.o arm-gen.o
make[2]: ../../../arm-toolchain473/bin/arm-none-eabi-ar: cannot find the program
Makefile:193: recipe for target `libtcc.a' failed
make[2]: *** [libtcc.a] Error 127
make[2]: leaving directory `/home/PH/magic-lantern/tcc'
../../Makefile.inc:378: recipe for target `../../tcc/libtcc.a' failed
make[1]: *** [../../tcc/libtcc.a] Error 2
make[1]: leaving directory `/home/PH/magic-lantern/platform/5D3.113'
Makefile:70: recipe for target `5D3' failed
make: *** [5D3] Error 2

In this case there is no "arm-none-eabi-ar" program under the gcc directory, I only found  the "arm-none-eabi-ar.exe"