Magic Lantern Forum

Using Magic Lantern => Raw Video => Topic started by: dlrpgmsvc on May 22, 2013, 12:11:45 PM

Title: 550D/T2i raw video recording port official thread
Post by: dlrpgmsvc on May 22, 2013, 12:11:45 PM
Here we will concentrate our efforts to port raw video recording to 550D, and continuously making it better and better !

Current 550D with RAW video builds (older ones are first, newer ones are the last towards the bottom of this post) :
To install: install the latest ML stable version, then substitute (overwrite) the files into the card with these

--------------------------------------------------------------------------------------------------------------------------------------------------------------
MK11174

The main thing is the ability to save RAW settings after restart.

Includes Magic and Tragic as well and Mem fix.

Anyone having hard time deciding which record module they like best out of Magic Unified vs the Tragic version, this will help you.
You will have 2 new option within Magic Lantern.
When you decide which you like best, just delete the other module or just keep both, your choice.


Obsolete link removed - Please use the official nightly builds //Audionut

--------------------------------------------------------------------------------------------------------------------------------------------------------------
MK11174

Anyone wanting to try out Alex's experimental variable buffer Raw Record, this build is all updated and has AUTO ETTR, File Manager and Pic View Module as well.

Obsolete link removed - Please use the official nightly builds //Audionut

--------------------------------------------------------------------------------------------------------------------------------------------------------------
MK11174

Alex disabled debug code and added a bit more speed as it says on the changeset.

Obsolete link removed - Please use the official nightly builds //Audionut

--------------------------------------------------------------------------------------------------------------------------------------------------------------
MK11174

Latest changes to everything. Includes modules, Raw_Rec, File_Man, Pic_View and ETTR, oh and a requested res of 1200 and aspect 2.42:1

Obsolete link removed - Please use the official nightly builds //Audionut

--------------------------------------------------------------------------------------------------------------------------------------------------------------
REWIND

raw_rec module from pravdomil's source:
https://bitbucket.org/pravdomil/magic-lantern-hack/commits/all

Raw_rec has some tasty features like black bars and auto global draw off while recording.

I've noticed a tiny but consistent frame count increase with this. For example, with my previous build i've got about 500–510 frames with 1200x496 at 24 fps, now i'm getting 550-570.

Also, there is a small present for those of you, who dare enough to shoot the tv works on 550d — nice 3X4 cropmark (useful for PAL world ).

Other stuff is from unified.

Notice: I have removed a large set of resolutions (useless for my works), and added 1200 and 1.42:1
This build also includes ETTR, file_man, pic_view.

Thread about this module : http://www.magiclantern.fm/forum/index.php?topic=5655.msg0#new

--------------------------------------------------------------------------------------------------------------------------------------------------------------
MK11174

Incredible milestone: all the previous raw stuff, plus the DUAL ISO feature for PHOTOS AND VIDEO !

Obsolete link removed - Please use the official nightly builds //Audionut





Current state-of-the-art :

Problem : Raw video recording works, finally ! Now we need to try to get more Buffer Memory like the other cams, even the 500D has 95Mb, while 550D only 75Mb as current development (68Mb was the memory available at the beginning of this development). With 500D, one gets higher res than on 550D, with no skip, thanks to the expansion of this memory.
You can see the status from the "0101" menu in ML : scroll down to "Free Memory", then press "Set" button on 550D and you will see the "shoot_malloc total" is 75mb : that needs to be al least 95mb (better if more, obviously). On 500D, this memory is native 95mb, without any intervention... we cannot understand why...

What to do :

[1] It seems we must enable sRAW option, but while on other cams it works, on 550D and EOSM it gives a "err70" error (http://www.magiclantern.fm/forum/index.php?topic=1746.msg6039#msg6039 (http://www.magiclantern.fm/forum/index.php?topic=1746.msg6039#msg6039)) that bricks the camera (can be un-bricked, however). We have to solve this problem.

[2] Some hints of past tryouts can be found here : https://groups.google.com/forum/?fromgroups#!msg/ml-devel/AyPANkaXbp0/PMwkzwuVy14J (https://groups.google.com/forum/?fromgroups#!msg/ml-devel/AyPANkaXbp0/PMwkzwuVy14J)

[3] There are clues that, in order to make room for the raw_video_rec module, we used the shoot_malloc memory to put there the ML code, so shrinking it, so we cannot have more shoot_malloc memory anymore... look at this : http://www.magiclantern.fm/forum/index.php?topic=5071.0

[4] Anyway, the source file to play with about this thing, is: src/exmem.c

[5] Without using sRAW option, %1 user managed to expand (even if by very little) the shoot_malloc memory by using this system : This is where he got more memory.
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/60b04d7254cf8c5add9ee4a96822a1a7c81e1503

[6] Following point [5], we can play with these values : https://bitbucket.org/hudson/magic-lantern/commits/39d536e2b72c39b81855526fbd08f4281931ccbb

[7] exmem.c - line around 147 -
hsuite = shoot_malloc_suite (max_size + backup_size - 8 * 1024 * 1024)
in this manner, the old version, we obtain 68Mb of shoot memory, good to serve as buffer for raw video (more memory, more resolution)
-----------------------------------------------------------------------------------------
hsuite = shoot_malloc_suite (max_size + backup_size - 1024 * 1024)
in this manner, the new and current version, we obtain 75Mb of shoot memory
-----------------------------------------------------------------------------------------
Our goal is to raise this shoot memory as high as possible, at least the 95Mb of 500D, but the maximum I managed to obtain is :
hsuite = shoot_malloc_suite (max_size + backup_size)
in this manner, we can have 76Mb of shoot memory
If you try even a :
hsuite = shoot_malloc_suite (max_size + backup_size + 1024 * 1024)
the result is 0 of shoot memory !
However, the interesting thing is that the autoexec.bin memory is not affected by the increase of the shoot memory.
-----------------------------------------------------------------------------------------
I have hitted a wall here...  :'(

[8] - Modifying the "backup_size" (by upsizing or downsizing it), doesn't sort any effect at all.
     - Changing the probe size from 4 to 2 and then to 1 (just to dig out more memory chunks), doesn't sort any effect at all.
     - Forcing "size" to zero into the shoot_malloc allocation function, just to force it to allocate the maximum size, takes the camera to stack
        overflows and freezes that need to pull out the battery: no luck...

[9] By a1ex hint: use CONFIG_MARK_UNUSED_MEMORY_AT_STARTUP, but it's defined as "dangerous" by a1ex himself (bricking camera risk ?)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 22, 2013, 12:29:21 PM
Here we will concentrate our efforts to port raw video recording to 550D !

Current state-of-the-art : module loads but when live view is enabled, the camera hangs...  :'(
Confirmed, hangs to black screen when trying to bring up live view in M mode or loading Movie mode. But module does load and shows up in menu, but cant set anything until live view is turned on, it just shows ON 0x0

(http://s22.postimg.org/tscbi42sx/VRAM1.png)
Title: Re: 550D raw video recording port official thread
Post by: IndyP on May 22, 2013, 06:23:38 PM
Hi Everyone,
   Can’t help but say a few words concerning RAW video for the T2i 550D. This camera may be considered  old when viewed against current technology or newer models, but it was at the forefront along side the 7D and 5D MK 2 at the beginning of the DSLR revolution.
   Their can be no doubt that many owners of the T2i are still producing great work with this camera and would like to continue doing so. These owners (including myself) would love to step up to a 5D MK3 and work these models along side each other, but the higher cost is a prohibiting factor.
   To myself and the other owners of the T2i that love using ML, the concept of having the capability to use RAW video on the T2i is both fascinating and exciting. I hope somehow, that not only future features, but RAW video, will also become available for this camera.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 22, 2013, 08:28:34 PM
Dear IndyP, your toughts are 100% mine also ! They are the main dream and motivation that opened this thread !  Many thanks for sharing your toughts ! They are exactly the soul of the efforts we are producing here !!! :)
Title: Re: 550D raw video recording port official thread
Post by: briwil on May 23, 2013, 01:14:10 AM
Can we expect any updates in tonight's build or no?
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 23, 2013, 02:03:20 AM
Oh! I thought they had gotten it working a bit. I guess that must have been the 600D. Well i can't imagine it'll be too long before this is fully up and running on the 550D, as the 600D is already up (and it is, essentially, the same camera).
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 23, 2013, 03:45:56 AM
No, not working on 550D yet, module can be loaded but that is it, camera crashes right away before you can do anything. So maybe something still has to be done in the code with addresses to enable it to load on this cam. Funny how not to long ago everything was all about the 550D and now even the 500D is winning this one. I wish I knew what needed to be done, I would do it, but I am not a programmer, but I can compile at least and if I am told what to do or guided I usually can get it done, but I guess we will have to be patient  till some developer with a 550D gets in the mood to finish it off. I just don't get why it is working on the 500D and the 650D but not with this camera, what can be missing?
Title: Re: 550D raw video recording port official thread
Post by: 1% on May 23, 2013, 04:15:39 AM
Memory is fixed? Registers are right?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 23, 2013, 04:34:49 AM
Memory is fixed? Registers are right?
Anything I can do to start checking?
Title: Re: 550D raw video recording port official thread
Post by: 1% on May 23, 2013, 04:55:27 AM
Look at what was done to boot-hack.c and 600D consts.h
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/all

Its booting into allocate pool and uses 640K bins. Just have to find the addresses in 550D firmware.
Title: Re: 550D raw video recording port official thread
Post by: unity2k on May 23, 2013, 05:00:11 AM
I too am of the happy 550D/T2i club of owners. I use two of the old cameras and as has been said, the 5D3 is too expensive for me to upgrade to. For those who are undertaking this task, my thanks and my hopes are with you that you find success in bringing raw video to those of us who still love creating content with these reliable cameras.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 23, 2013, 06:01:41 AM
Look at what was done to boot-hack.c and 600D consts.h
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/all

Its booting into allocate pool and uses 640K bins. Just have to find the addresses in 550D firmware.
Ah! Thanks for finally clearing that up for me, finally a real technical reason why it crashes when loaded, thank you very much for that info. Plus it gives hope that it should be fixable if the correct addresses are found.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 23, 2013, 02:50:44 PM
Can you tell me more precisely the source files and the lines where there are the addresses to find ? These hints are still so Smoky, at least for me... so I can be of the address-seekers squad !  ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 23, 2013, 03:13:39 PM
I to would help, but the last time I disassembled a firmware was 2 years ago for the a3300is to do a chdk port which luckily worked out well, but it seems looking through a firmware for these cams are different, and I am not even sure if I would use IDA like I did for chdk. I wish I knew how to set it up though cause I would surely take the time and start looking. Only thing I have now is the prebuilt compiler with vbox. I was using my own setup with ubuntu with the directions online to install it manually but it was the old toolchain and seemed smarter to start using this nice up to date prebuilt version. These guys in here are awesome for making that up for us wanna be hackers, lol.
Title: Re: 550D raw video recording port official thread
Post by: briwil on May 23, 2013, 07:50:04 PM
Can you tell me more precisely the source files and the lines where there are the addresses to find ? These hints are still so Smoky, at least for me... so I can be of the address-seekers squad !  ;)

If you have to ask something so specific... if they knew the answer to this, they could easily do it themselves  :o
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 23, 2013, 10:19:36 PM
is anyone currently trying to figure it out or are we all just waiting for it to magically appear out of thin air?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 23, 2013, 10:24:16 PM
Between sarcastic comments of who don't know ever what programming is, and unpolited newcomers with ever worse comments about what Others MUST do freely and FAST for them... i think that thin air is flowing very well for nothing through their mouths  ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 23, 2013, 10:40:43 PM
Im guessing the devs are very busy with this new 10bit / 12bit code and the 5d III I am sure eventually it will be set up for us, but probably going to be awhile, they look pretty excited about the new code which may benefit us SD card users if we ever get RAW going on our cam that is. I can use the feature on the 500D I have, just hate that I handed my 500D down to my kid when I got the 550D and now hers has a cooler feature, LOL!! But I am limited on what I know so I am done for now I guess since I don't know how to disassemble the firmware with these cams. Sorry guys!
Title: Re: 550D raw video recording port official thread
Post by: noisyboy on May 23, 2013, 11:01:33 PM
Okay - cool it dudes. Let's keep it polite now :)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 04:09:23 AM
I successfully captured a raw video on the 550D, I had to go into /src/all_features.h and disable many features to get enough memory for it to allow live mode plus the Rec module, but at least it seems to work. So far I was only able to capture 720x406x23.976fps without a skipped frame though. But it does work for sure, I extracted the DNG files from the RAW file it made and these look fine so far, more tests needed for other resolutions though, just thought I would update anyone interested.

And I know its only a temp fix because obviously we need our other features turned on, like 1% said, we need memory from the correct places I guess for it.

I feel better though just seeing it work on this cam!

UPDATE: Best I got with no skipping was 960x408 @23.976
Other Max res I can do with no skip
In 1920x1080x24fps mode
720x540 4:3 @23.976
640x480 4:3 @23.976

In 1280x720x60fps Mode
720x172 3:1 @59.940

In 640x480Crop Mode
640x214 3:1 @59.940

I am using freshly formatted each time 16gig 45mb/s Sandisk Extreme
Title: Re: 550D raw video recording port official thread
Post by: ifkey on May 24, 2013, 04:35:33 AM
I successfully captured a raw video on the 550D, I had to go into /src/all_features.h and disable many features to get enough memory for it to allow live mode plus the Rec module, but at least it seems to work. So far I was only able to capture 720x406x23.976fps without a skipped frame though. But it does work for sure, I extracted the DNG files from the RAW file it made and these look fine so far, more tests needed for other resolutions though, just thought I would update anyone interested.

And I know its only a temp fix because obviously we need our other features turned on, like 1% said, we need memory from the correct places I guess for it.

I feel better though just seeing it work on this cam!
How to install modules? no menu "M"
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 04:45:31 AM
How to install modules? no menu "M"
I can share my bin with you to have fun with, but I feel it might be best to wait for a Dev to give the ok since ML is there code, they will know if it is safe for testing in cameras with all the things I had to disable in all_features to get the memory to load the raw_rec module.

But it is running stable with no crashing, just can't have all the other cool ML features enabled for now till someone finds a way to get more memory for the 550D to have all loaded at once. Maybe for now we can just keep 2 bins ready to go and switch back and forth till we get the memory for al features at once.
Title: Re: 550D raw video recording port official thread
Post by: ifkey on May 24, 2013, 05:07:55 AM
I can share my bin with you to have fun with, but I feel it might be best to wait for a Dev to give the ok since ML is there code, they will know if it is safe for testing in cameras with all the things I had to disable in all_features to get the memory to load the raw_rec module.

But it is running stable with no crashing, just can't have all the other cool ML features enabled for now till someone finds a way to get more memory for the 550D to have all loaded at once. Maybe for now we can just keep 2 bins ready to go and switch back and forth till we get the memory for al features at once.
tnx i will wait
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 24, 2013, 06:08:06 AM
I can share my bin with you to have fun with

Can I have a play around on the bin please? If i have this bin on one memory card and the stable on the other i can switch between the cards? I am really eager to play with some raw footage.

Thanks
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 07:14:57 AM
Well, I was able to turn off a few more things to have enough juice to turn FPS back on.

So now we can get 1720x1156 @4fps for timelapse stuff or obviously you can play with FPS to get higher res.

I also can do 1280x720 @10fps no skips

I find that anything that is shows you need 16mb/s or more is to much and skips.

So thanks to the devs for the tweaks to the raw_rec file it gives us that nice info to make the right changes.

Oh, and that is with my card, I don't know what you would have to set to for slower or faster cards.
Title: Re: 550D raw video recording port official thread
Post by: zenlenz on May 24, 2013, 08:56:28 AM
Excellent progress mk11174  ;D Nice one!

If the offer of sharing your bin is still available? I'd love to have a look. Many Thanks.
Title: Re: 550D raw video recording port official thread
Post by: ifkey on May 24, 2013, 12:03:11 PM
sandisk extreme 45mb/s
960x540 18 fps no skip frames
this is max for 550d?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 24, 2013, 02:06:41 PM
@mk11174 : can you share with me your latest modifications and procedures on how to enable raw video and disable modules, so I can help you to solve the memory problem ? Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 02:23:11 PM
Alls I did was go into all_features in the/src and comment out anything not really needed and once it worked cause of having enough memory, I uncommented fps to get that going again.

This gets it working as good as it should be, but the only true fix is for someone to figure out how to get more memory available like 1% said so we can enable all of ML features with it.

But for now you can have fun and just use 2 bins, 1 with it and 1 without it.

There is nothing left to do really until someone figures the mem issue out.
Title: Re: 550D raw video recording port official thread
Post by: wolf on May 24, 2013, 02:55:14 PM
@mk11174 : can you share with me your latest modifications and procedures on how to enable raw video and disable modules, so I can help you to solve the memory problem ? Many thanks !
There is no need to disable modules, because raw_rec is a module.

Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 03:17:42 PM
He probably meant the features.  :)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 24, 2013, 03:20:37 PM
He probably meant the features.  :)

right ! thanks !  :P
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 24, 2013, 08:47:14 PM
mk11174 can i try your bin too? i dont know what feature to disable
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 24, 2013, 10:48:22 PM
mk11174: awesome news! Are you able to share your build with another 550d tester? If not, do you have an ETA for your work to make it into the Nightly Builds? In any case, great work. Cheers!


NedB

P.S. Can you also share the "Modules" folder or a link to where it can be downloaded? Great!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 24, 2013, 11:58:14 PM
For anyone else that wants to try anyway.
Just Raw_rec, no FPS  = http://www.mediafire.com/download/28yp9iaad5ep8qy/ML_Raw.rar
Raw and FPS added back = http://www.mediafire.com/download/b866nsqwokaeqq8/ML_Raw_FPS.rar
Raw and FPS added but took out a couple more things just to see if better results on capture. = http://www.mediafire.com/download/u8kdos53mkows9c/ML_RAW_FPS_FIX.rar

Remember, don't expect to see all of ML great features in the menus, the camera can't handle all at once yet so most are turned off to get this to work for now. So keep your other bin as a 2nd.
Title: Re: 550D raw video recording port official thread
Post by: wolf on May 25, 2013, 12:49:27 AM
@mk11174: Thanks for sharing.
I can get max 720x406 resolution. Maybe more with a better card?
Well, it's better to blow up DNG then h264.

Great :-)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 12:54:56 AM
@mk11174: Thanks for sharing.
I can get max 720x406 resolution. Maybe more with a better card?
Well, it's better to blow up DNG then h264.

Great :-)
Yeah, you should be able to I guess, my best res is 960x408 and works steady I captured a 1200 frame clip and decided to stop it cause it worked fine. Panning worked fine to. The hack thing does not seem to help anything. I have a 45 MB/s Sandisk Extreme 16GB
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 25, 2013, 02:01:58 AM
Bad news. As expected, the bottleneck is the SD controller inside 550D ! I tried with a Sandisk Extreme Pro Class 10, 16Gb, 95Mb/s : same results: max res without skipped frames is 960x408 at 24fps ! Sorry boys ! However a great achievement !

Bad news 2 : when playback the latest movie capture, my 550D shows a messed-up flickering screen then no more commands are accepted, you must switch off, but red led is on, and if you switch back on, camera is frozen with red led on, you must put out the battery and then reinsert it, then switch on again and all is ok. Do you experiment the same problem ? How to solve it ?
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 25, 2013, 02:11:17 AM
Bed news. As expected, the bottleneck is the SD controller inside 550D ! I tried with a Sandisk Extreme Pro Class 10, 16Gb, 95Mb/s : same results: max res without skipped frames is 960x408 at 24fps ! Sorry boys ! However a great achievement !

Bad news 2 : when playback the latest movie capture, my 550D shows a messed-up flickering screen then no more commands are accepted, you must switch off, but red led is on, and if you switch back on, camera is frozen with red led on, you must put out the battery and then reinsert it, then switch on again and all is ok. Do you experiment the same problem ? How to solve it ?

Yeah, same problems.
Also, how can I open the RAW as frame sequence? I have one big RAW file on my SD Card, but when i try to open it in After Effects (CS 5.5 / 6) nothing happens. Same in Photoshop / Lightroom (One big gray frame with noise).
Thanks in advance!
Title: Re: 550D raw video recording port official thread
Post by: derkiki on May 25, 2013, 02:22:29 AM
Thanks 11174!!

@moscow you have to use the raw2dng app for mac linux or win.
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 25, 2013, 02:27:02 AM
Yeah, same problems.
Also, how can I open the RAW as frame sequence? I have one big RAW file on my SD Card, but when i try to open it in After Effects (CS 5.5 / 6) nothing happens. Same in Photoshop / Lightroom (One big gray frame with noise).
Thanks in advance!

I think playback is only flickering in live view. If you change to one of the photo settings on the dial and then play back it doesn't flicker
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 25, 2013, 02:33:55 AM
Thanks 11174!!

@moscow you have to use the raw2dng app for mac linux or win.

Thank you!
Title: Re: 550D raw video recording port official thread
Post by: antoinecormier on May 25, 2013, 02:34:13 AM
First of all, I would like to thank you guys for all the effort you put into this project.
I've done some tests with your bin mk11174, and everything worked as expected (960x408 max at 24 fps, 1280x300ish at 17fps with override..)

Too bad, because the results with the 1280 (3:1) ratio were very wonderful ! And If you like shooting at a (very) wide ratio, It could be an amazing feature. When the RAW is scaled to 1920x640 It gives us a sharper image than the 1920x1080 H264 and RAW benefits.
The 960's resolutions miss a bit more sharpness to my mind.

Unfortunately, If I'm understanding well, It only has to do with the SD controler inside the 550D, that means that the only way (for the moment) that could help us is the "14 to 12 bits" experimentations ? Am I right ?

(I apologize for my pretty weak english, I'm french :/)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 03:08:12 AM
Yeah, I would reccomend not bothering with playback cause so many features are disabled that might have something to do with it, just use for recording cause after extracting with the raw2dng.exe the clip sequence is fine. Main thing is we get to record in raw.
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 25, 2013, 03:32:15 AM
Does anyone know how to make more custom resolutions or ratios? Is this possible? Bearing in mind still keeping under the card write limit.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 25, 2013, 03:40:50 AM
Yeah, I would reccomend not bothering with playback cause so many features are disabled that might have something to do with it, just use for recording cause after extracting with the raw2dng.exe the clip sequence is fine. Main thing is we get to record in raw.

how about separate images, is it really hard to record like that? another question, we can do almost anything with this cameras but we're still in the boundary of 4GB file limit, how can we break it? I've tested your bin on my 2 550Ds and I think I must sell my 550Ds and buy a 5D Mark III, or wait for a real HDR 1080p Uncompressed video recording Canon camera :)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 03:55:19 AM
I don't have anything to do with how the raw rec works, the developers here made it so they would be the only ones who could answer those questions, I don't have any knowledge how it works and am not a programmer, I just used trial and error to free up our memory to make it work for us, but no matter if they find the extra memory so we can use full use of ML and the raw rec, it wont change how Raw rec works, its the speed limit of our cam. We are stuck with it. And the Raw2DNG.exe is how everyone is extracting the RAW files, this is the way they built it. No idea if they plan to find a differ way.

For us it seems, if you want 24fps video, we have to just think of only getting standard def video and 720x480 or 640x480 not expect any more. or shoot 960x408 and blow it up to 1280x720, cause even blown up, it might get a bit softer, but the idea of being able to fix the overall levels of your video without messing the colors or brightness up like what happens when you try to fix up h.264 from the cam, well, that is so nice, and no compression artifacts to deal with either is nice as well. It just depends on what your using it for I guess. Just cool to have another feature to play with as far as I am concerned.  ;)
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 25, 2013, 04:12:11 AM
The idea looks good. But the bandwidth speed of 550D does not allow long record with this quality.
Low resolutions: virtually no sense to use it. Large resolution: Maximum of 30-60 frames and then buffer is filled.
Missed shots will not be needed to use.
Here is small test:
(http://cs416324.vk.me/v416324165/5410/eSPjyGbYVKs.jpg)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 04:24:10 AM
Anyone interested in seeing the files I edited to get there build to compile to have same results as I got, here are the files so you can see the changes, I added a install.txt just so you know where the files are found or go if you just replace them.
http://www.mediafire.com/download/vff8h5omvl9qmio/ML_RAW_MODS.rar
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 04:27:10 AM
The idea looks good. But the bandwidth speed of 550D does not allow long record with this quality.
Low resolutions: virtually no sense to use it. Large resolution: Maximum of 30-60 frames and then buffer is filled.
Missed shots will not be needed to use.
Here is small test:
Nice to see the detail you get compared to H.264 sux the 550D has a slow SD controller.  :(
Title: Re: 550D raw video recording port official thread
Post by: Soupertrooper on May 25, 2013, 06:20:51 AM
Would it be possible to override the sd controller? or is that just a terrible idea?
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 25, 2013, 08:18:47 AM
Hey guys. Today I thought: what if we will record footage directly to computer? I mean cable (from PC to Canon with usb 3.0 port) and SSD disk. EOS Utility could help in this, but here is one problem. When the card is not in Canon: shots go straight to the computer. When the memory card in the camera: shots go through the flash card, and then EOS Utility asks you want you to copy pictures from SD Card. Well, is it possible to install this firmware to make it work without SD Card? but I did not really know - it helps to speed up or no.
Title: Re: 550D raw video recording port official thread
Post by: ItsMeLenny on May 25, 2013, 09:03:43 AM
from PC to Canon with usb 3.0 port
Even if your computer has a usb 3.0 port, and you have your camera plugged into your usb 3.0 port, it will not make any difference as the camera is only usb 2.0.
Usb 2.0 is slower than writing to the SD card directly.
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 25, 2013, 09:16:39 AM
Even if your computer has a usb 3.0 port, and you have your camera plugged into your usb 3.0 port, it will not make any difference as the camera is only usb 2.0.
Usb 2.0 is slowed than writing to the SD card directly.

damn, then have no idea how to speed up
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 25, 2013, 10:20:29 AM
damn, then have no idea how to speed up

yep, we're stuck with it. 7D has double processing power of 550D, I hope they'll crack the code of it and make a cheap RAW recorder camera
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 25, 2013, 10:35:24 AM
I cling to the hope of 10 bit compression  ??? But yes the SD bottleneck is a bummer.

However I really love the latest build of MagicLantern. It is feature rich with a great UI. I have been timelapsing and HDRing lots again. So thanks a1ex and the team I still appreciate everything you did for my baby RAW cam  ;)
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 25, 2013, 10:38:51 AM
we can always capture HDR video, it works for now :)

(http://fc00.deviantart.net/fs70/f/2013/144/c/0/941696_651725921509506_1426685826_n_by_weraqs-d66g40a.jpg)
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 25, 2013, 01:58:02 PM
mk11174: Thanks very much for sharing your builds. They worked exactly as you described; 960x408 (23.976fps) is the max I am getting as well, with a SanDisk Extreme 30MB/s Class 10 8GB card. I'm just finishing up a comparison with H.264 which I will post when it is finished. The detail in the raw pics compared to that in a cropped H.264 video is just amazing. And opening them in ACR and being able to push and pull them so much without them falling apart is really exciting.
Also, thanks for sharing the documentation of the changes you made. This is going to force me to get a build environment going. May I ask which OS you are using for compiling, and how you set up your tool chain (pre-built toolchain, VM, or DYI)? Cheers!
Title: Re: 550D raw video recording port official thread
Post by: Videoteq on May 25, 2013, 02:05:20 PM
Just shot a short clip on a 550D with a 45MB/s Sandisk 16GB card using mk11174's hack from http://www.mediafire.com/download/b866nsqwokaeqq8/ML_Raw_FPS.rar

720x406 @25fps

Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 25, 2013, 02:22:05 PM
May I ask which OS you are using for compiling, and how you set up your tool chain (pre-built toolchain, VM, or DYI)? Cheers!

I advice you to use the VM: fast, easy, hassle-free, no other configurations needed ! ;)
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 25, 2013, 04:26:41 PM
7D has double processing power of 550D
Who cares? The speed of the CPU has absolutely no effect on the raw recording ;)

It's all about buffer size and write speed. If you want a cheap DSLR with a big buffer and a fast write speed: Canon EOS 50D.
Its buffer is more than two times larger than the 550D's one and it has write speed limit of ~ 85 Megabyte/s. They cost around 300 € ...
See here:

- Raw video on 50d and 40d (http://www.magiclantern.fm/forum/index.php?topic=5586.0)
- Raw Burst on the 50D (http://www.magiclantern.fm/forum/index.php?topic=5481.0)

But I think on the 550D you haven't reached the limit yet. On my EOS 600D I'm able to get these results:

- 1280 X 400 at 24 frames/s: Up to 4 GB file size limit
- 960 X 540 at 24 frame/s: Up to 4 GB file size limit
- 720 X 720 at 24 frame/s: Up to 4 GB file size limit

[With this SD-card: SanDisk Extreme 16 GB SDHC Class 10 UHS-1 | 45 MB/s (http://www.amazon.com/SanDisk-Extreme-Class-Memory-SDSDX-016G-AFFP/dp/B007M54E08/ref=sr_1_3?ie=UTF8&qid=1369491356&sr=8-3&keywords=sandisk+extreme+45+mb%2Fs)]

Since the 550D and the 600D are nearly the same camera and both have a max. write speed of 21.3 Megabyte/s you should be able to get similar results.

Btw.: If you want to compare H.264 and RAW video, make sure that you count in the crop factor. Otherwise your comparison would be completely pointless (Because the RAW videos are just crops of the H.264 frames ;) ) Here are the crop factors you'll get with the raw resolutions:

Width | Cropfactor | Multiple of H.264 crop

1734 = 1.60 | 1
1280 = 2.17 | 1.36
960 = 2.89 | 1.81
720 = 3.85 | 2.41

So if you shoot a video in 1920 X 1080 H.264 at 55mm and you want to compare it with a 960 X 540 raw video you have to change the focal length to 30mm (55 / 1.81 = 30).

Have a nice day :D
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 25, 2013, 04:42:16 PM
But I think on the 550D you haven't reached the limit yet. On my EOS 600D I'm able to get these results:

- 1280 X 400 at 24 frames/s: Up to 4 GB file size limit
- 960 X 540 at 24 frame/s: Up to 4 GB file size limit
- 720 X 720 at 24 frame/s: Up to 4 GB file size limit

[With this SD-card: SanDisk Extreme 16 GB SDHC Class 10 UHS-1 | 45 MB/s (http://www.amazon.com/SanDisk-Extreme-Class-Memory-SDSDX-016G-AFFP/dp/B007M54E08/ref=sr_1_3?ie=UTF8&qid=1369491356&sr=8-3&keywords=sandisk+extreme+45+mb%2Fs)]

Since the 550D and the 600D are nearly the same camera and both have a max. write speed of 21.3 Megabyte/s you should be able to get similar results.

The max performances are the ones you see here, confirmed by many 550D users. What parameters do you use, beside the ones you described, lilke: main dial position, Canon menu video mode, inherent ML menu settings, and so on... ??? Perhaps 600D has more buffer memory ?
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 25, 2013, 05:00:15 PM
I get the best results with the following settings:

- Mode Dial: Video
- 1080 X 1920 24p Canon mode
- Global Draw: Off
- FPS override: Off
- Sound recording: Off
- "Pic Quality" set to "SRAW"

Maybe the "Pic Quality" trick doesn't work on the 550D? It should increase your "shoot_malloc total" if you set it to "SRAW" and then reboot your camera.

The Canon 600D had 74 Megabyte buffer for shoot_malloc. A1ex did something ... Now it's only 68 Megabyte - Without "Pic Quality" trick!
With it set to "SRAW" it's 96 and it was 104 once. If you want to know how much your 550D has, go to "Debug" menu and press "Q" on "Free Memory". As far as I know "shoot_malloc total" is what you're looking for.

Maybe the 550D just needs some more work to get where the 600D is?
Well, with the 21 Megabyte/s write speed limit we're screwed anyway  ;D
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 25, 2013, 05:49:13 PM
I just installed the latest nightly build on the Canon 550d and yes, - the shoot_malloc total is 68M as it is on the canon 600D
That being said, I would like you to forgive my ignorance on two things:

I consider myself fairly competent, and maybe I need more sleep, but I do not see any option to change the picture quality on the latest build of ML/Canon 550d?

Also, despite some poking around the forums, I cannot determine how to install a module on the camera. Again, the build from 5/24 is on there, but (obviously) no option for RAW.

Thanks in advance guys. 
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 25, 2013, 06:03:08 PM

It's all about buffer size and write speed.

you're obviously missing the point :) 7D can handle 8 RAW frames/sec with 120JPG buffer, what does 550D have? 12frame JPG buffer :)

and btw, 7D has CF card slot, 550D SD :) .. just really enjoyed while reading your post CFP :)

really, compare 550D and 7D in real life.
Title: Re: 550D raw video recording port official thread
Post by: goldenchild9to5 on May 25, 2013, 07:20:25 PM
Got a question for everybody on the this thread.. 

600D, or 550D ????

Trying to decide on which one to get.
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 25, 2013, 07:56:32 PM
you're obviously missing the point :) 7D can handle 8 RAW frames/sec with 120JPG buffer, what does 550D have? 12frame JPG buffer :)

and btw, 7D has CF card slot, 550D SD :) .. just really enjoyed while reading your post CFP :)

really, compare 550D and 7D in real life.
You're missing the point of my post too, I guess :)

I wasn't comparing the 7D and the 550D but the 50D ;)

Sorry if I didn't express myself right. I'm no native speaker.

What I wanted to say is that a 7D might be a great camera. But when you're looking for a cheap camera that can actually record raw videos at high resolutions, then a used 50D seems to be the best one at the moment.
Especially since the two CPUs of the 7D might not be helpfull for raw video.

The 7D is great! No doubt! But the 50D has the same CF-controller as the 5D Mark II (Up to 90 Megabyte/s write speed) and it actually has a working Magic Lantern.
The 7D might have an even bigger buffer (?). But it is more expensive and at the moment it looks like it'll be the very last Canon DSLR that will get raw video (according to 1%) ...

So if you want a cheap camera for raw video now, I would go for a 50D instead of a 7D. If you can wait, then wait. I know the 7D looks really promising on paper. But I'm sure it will need a while until the developers will enable raw videos for the 7D, since it's so different from the other Canon DSLRs.

Hope that cleared things up :D
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 09:35:02 PM
I used Windows 7 64bit and VirtualBox using the prebuilt setup from here.
Title: Re: 550D raw video recording port official thread
Post by: 1% on May 25, 2013, 09:36:41 PM
There is nothing that can be done with the SD controller.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 25, 2013, 11:04:36 PM
Do we have the impression that a lower bit-rate will have an impact? (or is that what we are trying to discover?  :D )

It appears as if they are making strides over at this forum: http://www.magiclantern.fm/forum/index.php?topic=5601.0

My thought is that this still looks promising as I am hearing good things about the 600D and that device only has a SD card slot and the buffer is pretty much the same. And I am very willing to be proven wrong  :P  Feel free.

My assumption is that the ability to shoot raw video will be able to be performed on the camera to some extent, but just based on the inherent limitations of the camera (550D), even 1280 by 720 might be pushing it to it's limit.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 25, 2013, 11:14:48 PM
Anyone interested, I enabled a bunch more things, I think it is at its max though, but seems to run the same as before  :D

http://www.mediafire.com/download/akpnykdda78e9ua/ML_RAW_FPS_FIX2.rar

By the way, this is from the latest changeset as well so all up to date.
Title: Re: 550D raw video recording port official thread
Post by: ddelreal on May 26, 2013, 12:10:15 AM
This is very exciting!!! This will breathe life back into my 550D's.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 26, 2013, 12:15:12 AM
mk11174, thanks for the latest build, haven't had chance to install or use it yet, need to get some more SD media, but is AutoETTR available?

Regarding SD media, is class 10 (New Faster Version) 45MB/s 32GB's Sandisk EXTREMES sufficient for raw video capture on 550D, so reasonable price. :-)

I've been using UHS Class 1 90MB/s on a 550D for h264 but now it's known how slow the SD port is what's the point?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 26, 2013, 12:58:32 AM
No, alex did not enable it for the 550D, I did to see if it worked, it seems to do something, but I don't know if it is accurate for this cam, but no, I kept it disabled for now, it will prob just use more memory anyway making Raw not work, we are at the very limit for sure, not good to turn on any other features with the Raw bin, it will crash for sure. But I got more features on at least so it feels like ML is back at least.

And no, I don't see a point to get a faster card, the controller in the cam is the limiter, no faster card will make any differ.

Update: I enabled AutoETTR and it worked, only in photo mode but it looks like it works, cam is for sure at mem limit, I did get 1 crash first boot after making new bin but have not been able to crash it again yet, But it is for sure at the limit. The BIN is at 444.2KB any bigger it crashes cam.

I am happy with everything that is enabled so far though. I will keep playing with ETTR enabled and if I dont get anymore crashed I will add it and send the link for it.
Title: Re: 550D raw video recording port official thread
Post by: leohds on May 26, 2013, 01:32:28 AM
This FIX2 is doing great, I dont get playback bug on my slow card =)
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 26, 2013, 01:51:11 AM
mk11174: Thanks again for the newest (FIX2) build, and for your answer re: build environment.

Just tested out FIX2 and for me at least, 960x408 gives me only 85 frames instead of continuous, while 960x402 gave me a couple of hundred before skipping a frame. So raw performance seems to be just a hair worse with all this stuff enabled, as you probably suspected. Tested this with Hack on and off and with Global Draw on and off. FYI! Look forward to reading about your continued experiments. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 26, 2013, 02:09:00 AM
OK, here is the Raw Rec bin with more more features and Auto ETTR, may crash 1 st try or randomly cause memory filled, but I only had it happen once first time using it, but just expect, just trying to get as many features going as possible.

http://www.mediafire.com/download/37ag5vd6z7mm4vj/ML_Raw_fps_ETTR.rar

On this one Hack on seems to help get 960x408 going for me like it was before adding stuff back.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 26, 2013, 02:43:48 AM
"fix2" worked great for me at a couple resolutions at least for several seconds or so.

The new features added and autoETTR - not as much success. This buffer issue (I assume)  is really hindering any success with any significant amount of data.

As said before however...really appreciate your diligence mk11174!!
Title: Re: 550D raw video recording port official thread
Post by: tackyattack on May 26, 2013, 02:44:06 AM
Anyone interested, I enabled a bunch more things, I think it is at its max though, but seems to run the same as before  :D

http://www.mediafire.com/download/akpnykdda78e9ua/ML_RAW_FPS_FIX2.rar

By the way, this is from the latest changeset as well so all up to date.

Awesome! I am having trouble installing it though. When I try to update to the FIX2 firmware, I get the following message:
"Update file cannot be found. Please check the memory card and reload the battery and try again."

Thanks!
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 26, 2013, 06:37:55 AM
Awesome! I am having trouble installing it though. When I try to update to the FIX2 firmware, I get the following message:
"Update file cannot be found. Please check the memory card and reload the battery and try again."

Thanks!

Just replace the files on your SD Card (with installed ML v2.3) using PC.
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 26, 2013, 06:45:17 AM
Does anyone know if the sd write limit is controlled by the hardware or the software? surely the answer to faster write speed is still buried in the firmware somewhere? Because 20m seems kinda slow?
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 26, 2013, 07:05:14 AM
for freeing more memory, 1% told me this:

http://www.magiclantern.fm/forum/index.php?topic=5634.msg40011#msg40011

but just reading it makes me dizzy.
Title: Re: 550D raw video recording port official thread
Post by: Audionut on May 26, 2013, 07:20:18 AM
Does anyone know if the sd write limit is controlled by the hardware or the software?

It's a hardware limit.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 09:22:16 AM

http://www.mediafire.com/download/37ag5vd6z7mm4vj/ML_Raw_fps_ETTR.rar


I've just installed the version and switched to movie mode, when I zoom in camera crashed
(http://fc04.deviantart.net/fs71/f/2013/146/e/e/untitled_by_weraqs-d66ly49.jpg)

here is the log;

ASSERT: dwDeadLine != 0xFFFFFFFF
at LVState.c:5842, task LiveViewMgr
lv:1 mode:20


Magic Lantern version : v2.3.NEXT.2013May26.550D109
Mercurial changeset   : b1b83dc89db7+ (unified) tip
Built on 2013-05-25 23:53:21 by magiclantern@magiclantern-VirtualBox.
Free Memory  : 265K + 1977K
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 26, 2013, 09:26:58 AM
I've just installed the version and switched to movie mode, when I zoom in camera crashed
(http://fc04.deviantart.net/fs71/f/2013/146/e/e/untitled_by_weraqs-d66ly49.jpg)

here is the log;

ASSERT: dwDeadLine != 0xFFFFFFFF
at LVState.c:5842, task LiveViewMgr
lv:1 mode:20


Magic Lantern version : v2.3.NEXT.2013May26.550D109
Mercurial changeset   : b1b83dc89db7+ (unified) tip
Built on 2013-05-25 23:53:21 by magiclantern@magiclantern-VirtualBox.
Free Memory  : 265K + 1977K
Yeah, there will be errors till we can get more memory to turn on all features.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 09:32:57 AM
now I've captured a minute long scene with all the features off except RAW Video, seems fine, on render at After Effects
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 26, 2013, 09:35:04 AM
now I've captured a minute long scene with all the features off except RAW Video, seems fine, on render at After Effects

what a resolution?
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 09:44:37 AM
what a resolution?

not extreme, 960x320 is enough for some situations, now trying to get more speed with different SD card
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on May 26, 2013, 09:52:21 AM
Does anyone actually know the download speed of the usb port? Is it usb 2.0? The speed should be up 400mbs???
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 26, 2013, 10:58:28 AM
Download is read speed isn't it? Anyway doesn't ML benchmark your card (CF or SD) to get average write speed. Doesn't matter what the spec is, just what the card/camera can really do.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 11:00:11 AM
Does anyone actually know the download speed of the usb port? Is it usb 2.0? The speed should be up 400mbs???

even with Sandisk Extreme 45MB/s 550D can reach max 18MB/s on USB 2.0, so it doesn't matter if you use a SD card or USB cable. we know what we can make out of 550D theoretically, but we're bounded with hardware limits..
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 11:06:55 AM
I am not getting any stable video on Exceria 60MB/s sd card. Regardless of the resolution I choose frames start dropping very fast. With the smallest possible crop it shoots for some time then camera goes to a sleep mode and when I wake it up rec module is unloaded and settings are not saved...
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 11:27:33 AM
I am not getting any stable video on Exceria 60MB/s sd card. Regardless of the resolution I choose frames start dropping very fast. With the smallest possible crop it shoots for some time then camera goes to a sleep mode and when I wake it up rec module is unloaded and settings are not saved...

Adjust camera sleep interval at

 (http://fc02.deviantart.net/fs71/f/2013/146/d/7/vram7_by_weraqs-d66m78v.jpg).

Toshiba exceria pro cards can handle data flow at extreme rates, other exceria cards not stable. they have incredible speeds on their spec sheets but I advice you to use at least Sandisk Extreme 45MB/s on 550D with RAW video.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 12:33:45 PM
Thanks, will try this now
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 26, 2013, 12:35:33 PM
I get the best results with the following settings:

- "Pic Quality" set to "SRAW"

Maybe the "Pic Quality" trick doesn't work on the 550D? It should increase your "shoot_malloc total" if you set it to "SRAW" and then reboot your camera.

The Canon 600D had 74 Megabyte buffer for shoot_malloc. A1ex did something ... Now it's only 68 Megabyte - Without "Pic Quality" trick!
With it set to "SRAW" it's 96 and it was 104 once. If you want to know how much your 550D has, go to "Debug" menu and press "Q" on "Free Memory". As far as I know "shoot_malloc total" is what you're looking for.


Where is to set this "SRAW" parameter ? Canon or ML ? And where ? Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 26, 2013, 12:54:41 PM
I can confirm also: no more playback problems with the latest "ettr enabled" (and Others features enabled inside) release from MK11174 ! I updated the "state-of-the-art" head post of this thread. Great, guys !  ;D
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 01:18:39 PM
Can anyone point me to instructions for combining dng's into a video? What's the workflow with open source tools?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 26, 2013, 01:22:19 PM
Geez!!! I can't even find the dump for the cam, I read that there are tools for it, but I must be looking in the wrong place, cause am I wrong or do we use the canon firmware now? When I did on a3300 for chdk I had to dump the firmware and use that. I don't even know if I will figure it out, but I am trying for sure.

Or is the dump tool in debug.c? I remember something about ROM0.bin etc...? Anyone know?
Title: Re: 550D raw video recording port official thread
Post by: moscow on May 26, 2013, 01:23:42 PM
Can anyone point me to instructions for combining dng's into a video? What's the workflow with open source tools?

Drop your RAW file into Raw2Dng.exe, then you will see how dng files extracting from your raw file. After it, open Adobe After Effects and select first dng frame (like 000001.dng), then click on - RAW Sequence and click OK. You will get video sequence.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 01:47:36 PM
I don't have adobe after effects. Is there another option?
Title: Re: 550D raw video recording port official thread
Post by: luke2578 on May 26, 2013, 02:07:59 PM
pavelpp. If you want to use totally free programs on a PC, you can use Gimp to do the raw conversions to a sequence of stills, such at BMP, TGA or JPGs
http://www.gimp.org/

You can then download Virtualdub and open the sequence of stills by clicking on the first still and it should load up the sequentially numbered stills as one video. Go to the Video option in the menu and change the frame rate to 24. In the same menu (Video), choose what compression you'd like to use and then save the file as an AVI.
http://www.virtualdub.org/

If using a Mac, just do the same thing with Gimp but use something like Quicktime Pro to open an image sequence and choose a frame rate of 24. Encode the file using the Quicktime Pro export options.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 26, 2013, 02:16:06 PM
I don't have adobe after effects. Is there another option?

If you have Windows, then -> RAWanizer ! --> http://www.magiclantern.fm/forum/index.php?topic=5557.0  ;D
If you have other systems, I dunno  :-\
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 03:05:55 PM
sorry, forgot to mention that I am on Mac
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 26, 2013, 03:56:31 PM
overall, I'm pleased with the results, tomorrow I'll try to capture more RAW footage. its nice to resize and get rid of the Noise on After Effects CS6, processing a bit slow but its because of my CPU (i5 2450M) & GPU (Adobe doesn't support 7670M).

Currently my processing workflow is like that;
Capture RAW at 960x320 (only stable one on my 550D & 45MB/s sandisk extreme)
Export frames using Raw2dng.exe
import them to After Effects
color correct using Adobe RAW plugin
resize and render as tiff or h264 for final result.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 26, 2013, 03:59:53 PM
@mk11174, finally having chance to try your 550d build out, 960x540 2.35:1 ie: 960:408 is about the best I can get, Sandisk Extreme Pro 95MB/s or 45MB/s makes no difference as discussed previously, which is fine. :-) Doing the buffer test gave me no more than 21.8 MB/s at it's occasional best.

But I have a couple queries.

1. I'm using a dedicated SD card for raw video, 960:408 is the largest resolution, aspect ratio is ok so it would be great not to have to keep going in and setting 'RAW video' to ON, then choosing resolution, then choosing Aspect Ratio whenever I switch the camera off and on between shots.

2. It's great to have the overlays, raw histogram, focus peaking and crop marks then switch to clear overlays for recording. But is there any chance of keeping crop marks on, trying to judge where the letterbox is for keeping framing is difficult. :-)

Going to try your Auto ETTR build next, thanks for your continued work for the 550d owners. :-)

Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 26, 2013, 04:08:36 PM
y3llow I still haven't bitten the bullet.  :-[ How many frames are you able to record? Continuous or just a buffer dump? What are you processing with?
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 26, 2013, 04:18:41 PM
Hi 3point, sorry yes should have said, that's 'continuous', 500 - 600 frames or more before I stop rather than camera stopping. :-)

Processing wise, if I go from dng's then RAWTherapee as Darktable crashes with the dng's, need to mention it to the DT devs or have been using dcraw directly to 16bit Tifs various colorspaces, which DT then handles no problem.

Then I think possibly image sequences into Blender, edit and frameserve out through Avisynth for temporal noise reduction, luma sharpening, upscaling and encoding via x264. Or proxys via kdenlive to intermediate -> Avisynth -> x264.
Title: Re: 550D raw video recording port official thread
Post by: antoinecormier on May 26, 2013, 04:20:54 PM
Hello !
So I've tried your latest version mk11174, and I may have found a way to use the actual RAW rec module, a way that suits my needs...
I'm not really pleased by the 960x408 resolution, to my mind we are losing too much sharpness.
That's why I go 1120x374 (3:1 aspect ratio, Yep, I know that's an ultra wide ratio  ::)...) and It manages to work without frame skipping !
But you have to set your FPS override to 23 fps (prefer "exact" in the FPS override settings, It seems to run better...).
The difference between 24 and 23 is hardly discernible.

Anyways, when you scale the RAW image to 1920 the results are pretty good in terms of sharpness, and you have control over the RAW possibility ! The "landscape" still miss a bit of sharpness but at least you gain the benefits of the huge dynamic range !

Here are some screenshots

https://www.dropbox.com/s/rvucbjcgt9wj665/first%20screen.png

https://www.dropbox.com/s/a9tkll47esccswt/large.png

Have a nice day !
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 26, 2013, 05:58:03 PM
Where is to set this "SRAW" parameter ? Canon or ML ? And where ? Many thanks !
On my EOS 600D it's only in the Magic Lantern menu. It's in the "Shoot" tab. The setting is labeled "Pic Quality". Setting it to "SRAW" does the trick for the 600D. But you have to reboot the camera to see the effect.

But maybe it's one of the functions of ML that are disabled at the moment? If that's true, then it should be renabled. It's all about buffer size and write speed. And even a couple Megabyte more buffer will make a huge difference in how much frames you can get.

Since every camera seems to have a "Pic Quality" setting that increases the buffer size (e.g. "SRAW" for 600D = 30 MB more, "JPEG" for 60D = 94 MB more), the 550D should have one too. You just have to find it and I'm sure you'll get almost the same performence as the 600D.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 26, 2013, 06:05:16 PM
2. It's great to have the overlays, raw histogram, focus peaking and crop marks then switch to clear overlays for recording. But is there any chance of keeping crop marks on, trying to judge where the letterbox is for keeping framing is difficult. :-)

http://www.mediafire.com/download/c5c07edkkdzfkjz/ML_Raw_Fps_Ettr_Crop.rar
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 26, 2013, 06:52:55 PM
mk11174, thanks for latest build, I got to apologize  :-[ , the 'cropmarks' was wrong term, I meant the white rectangle that's on screen showing the 'crop' area for the 960x540 2.35:1, it disappears with 'Clear Overlays', sorry and thanks again.
Title: Re: 550D raw video recording port official thread
Post by: luke2578 on May 26, 2013, 06:59:00 PM
Here's a video test I've made using raw video at 1280 x 720 (getting around 21 frames at a time using a 7dayshop.com class 10 SD card) and a longer sequence of images at 960 x 540 (around 62 frames at  time). I haven't tried lower resolutions as yet.

https://vimeo.com/67002231
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 26, 2013, 07:21:38 PM
On my EOS 600D it's only in the Magic Lantern menu. It's in the "Shoot" tab. The setting is labeled "Pic Quality".

Many thanks ! Unfortunately this menu item is not present in ML on 550D, full version (not the ripped-one for raw video).
Perhaps it's a feature useable only on 600D and other models, or it's simply not enabled on 550D... do some experienced developer can shed light on this ? Many thanks !!
Title: Re: 550D raw video recording port official thread
Post by: Pharinen on May 26, 2013, 09:09:58 PM
Hello !
So I've tried your latest version mk11174, and I may have found a way to use the actual RAW rec module, a way that suits my needs...
I'm not really pleased by the 960x408 resolution, to my mind we are losing too much sharpness.
That's why I go 1120x374 (3:1 aspect ratio, Yep, I know that's an ultra wide ratio  ::)...) and It manages to work without frame skipping !
But you have to set your FPS override to 23 fps (prefer "exact" in the FPS override settings, It seems to run better...).
The difference between 24 and 23 is hardly discernible.

Anyways, when you scale the RAW image to 1920 the results are pretty good in terms of sharpness, and you have control over the RAW possibility ! The "landscape" still miss a bit of sharpness but at least you gain the benefits of the huge dynamic range !

Here are some screenshots

https://www.dropbox.com/s/rvucbjcgt9wj665/first%20screen.png

https://www.dropbox.com/s/a9tkll47esccswt/large.png

Have a nice day !
What build you're using?

This? http://www.magiclantern.fm/forum/index.php?topic=5582.msg40579#msg40579

I tried to record 1120x374 @ 23 fps, but I only got 62 frames..

BTW 960x408 @ 23.976 fps seems to be very stable, I just recorded almost 7GB(~11 000 frames) file.

I'm using Sandisk Extreme 45MB/s card.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 26, 2013, 09:15:07 PM
BTW 960x408 @ 23.976 fps seems to be very stable, I just recorded almost 7GB(~11 000 frames) file.

I'm using Sandisk Extreme 45MB/s card.

But... how the 4Gb limit problem was solved here ?!?!? 7Gb file ?!? Are you sure ?!?  :o
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 26, 2013, 09:25:51 PM
It must be my Toshiba card, it says 60MB/s write speed, but I still can't get more than 20 fps stable in 960x408
Title: Re: 550D raw video recording port official thread
Post by: Pharinen on May 26, 2013, 09:30:55 PM
But... how the 4Gb limit problem was solved here ?!?!? 7Gb file ?!? Are you sure ?!?  :o
I recorded ~5GB and 7900 frames file just a moment ago

So yep, I'm 100% sure:

[spoiler](http://i.imgur.com/457xgZX.png)[/spoiler]
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 26, 2013, 09:33:51 PM
You can bypass the 4GB limit if you format your SD card as exFat.
Many thanks ! Unfortunately this menu item is not present in ML on 550D, full version (not the ripped-one for raw video).
Perhaps it's a feature useable only on 600D and other models, or it's simply not enabled on 550D... do some experienced developer can shed light on this ? Many thanks !!
I don't know if this feature should be available on the 550D ...

It wasn't supposed to change the buffer size but to allow taking raw stills with low resolutions.
I accidently found out that it has an affect on the size of shoot_malloc - The buffer that is used to store the raw frames :D

As far as I know some of the more expensive cameras like the 7D have this feature even without ML. So maybe it's just for the 600D at the moment ...

Well, I searched a little bit in the Magic Lantern forum and found some interesting quotes:

I'd rather try this kind of experiments on 60D in C mode, where settings are not saved to ROM. But the 60D already has MRAW/SRAW... [...] You can save MRAW/SRAW from 550D, but nobody was able to develop these files. [...] On 550D, the user interface gets corrupted when enabling MRAW/SRAW. [...] Be careful: setting one property may cause other properties to be changed.
Is it still in the code? Maybe I can try it again?
(Source: 10mp raw picture option for xxxD's (http://www.magiclantern.fm/forum/index.php?topic=1746.0))

To me it looks like 1% had some kind of success. The raw images I get in SRAW and MRAW actually are smaller ... Although they still won't open in Lightroom.
But what's more exciting about this is that it did exactly what a1ex suspected. It changed one other propertie: The shoot_malloc size!

But maybe a1ex disabled it for the 550D since it's seems to be very buggy and it didn't work anyway? I think you should ask a developer to renable it.

Btw. here is how it should look like: Shoot tab on 600D (https://docs.google.com/file/d/0B1Hu7J2NCF4vblhsNGpYalBYeFk/edit?usp=sharing)
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 26, 2013, 09:37:28 PM
i am very pleased by the results of 4:3 640*480 raw when shooting with a 2x anamorphic lens
stretching horizontally and getting 1280*480

http://postimg.org/image/7o1xbkj1z/
although its out of focus or motion blured
Title: Re: 550D raw video recording port official thread
Post by: antoinecormier on May 27, 2013, 12:36:55 AM
What build you're using?

This? http://www.magiclantern.fm/forum/index.php?topic=5582.msg40579#msg40579

I tried to record 1120x374 @ 23 fps, but I only got 62 frames..

BTW 960x408 @ 23.976 fps seems to be very stable, I just recorded almost 7GB(~11 000 frames) file.

I'm using Sandisk Extreme 45MB/s card.

Hello Pharinen !
To answer you : I'm using the same card as you, the Auto ETTR build (the one that you pointed out). The only things that are enabled are the RAW Histogram, the FPS Override (23 fps) and the Raw Rec Module. I've disabled the sound recording, and I've enabled the "Hack Mode" (that seems to do absolutely nothing...)

Have you tried to set your "FPS override" to a lower fps (22, or even lower) ?
I manage to shoot continuously at 23 fps. The maximum frames I've recorded must be something like 2000 frames.


My build version and my way of using it have nothing special, I'm afraid that I can't help you...

The next step would be to enable the SRAW choice, don't know If It could improve the raw recording, but It may help us in enabling more stuff !

Oh, And I've noticed something pretty weird and I don't know if something can be done about that :

The write speed goes down and then goes up and down again... It's not constant and varies A LOT (20mo/s and then 18mo, 16, 15, 21, etc...). I've read somewhere that wthe the Sandisk 95mo/s this speed stays at 20ish mo/s and doesn't vary.

Is it true ? If yes, the 45mo/s Sandisk card could manage to get the same results one day ? Or is it something more complicated ?

Anyways, thanks all for the efforts you put into hacking our 550d !

Have a nice day !
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 27, 2013, 02:01:28 PM
anyone tried the lv_rec module? what does that do?
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 27, 2013, 03:28:40 PM
anyone tried the lv_rec module? what does that do?
lv_rec was the predecessor of the current raw_rec module.

It wasn't really great. If even the much faster raw_rec doesn't work properly on the 550D then lv_rec will be completely useless ;)

And lv_rec was mainly for recording 422 video, not raw.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 27, 2013, 04:02:36 PM
Do this raw video for 550d is 14 bit and 422 or 14 bit 444, really ?
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 27, 2013, 06:31:57 PM
ok so is there any way that raw_rec records the whole lv (even in small resolutions) or it only works in "crop mode"?
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 27, 2013, 06:40:40 PM
I get continuous recording at 1120x374 at 22fps (using FPS override)

(http://i407.photobucket.com/albums/pp156/MOE-GUNZ-JACKSON/Raw3.jpg) (http://s407.photobucket.com/user/MOE-GUNZ-JACKSON/media/Raw3.jpg.html)

(http://i407.photobucket.com/albums/pp156/MOE-GUNZ-JACKSON/Raw1.jpg) (http://s407.photobucket.com/user/MOE-GUNZ-JACKSON/media/Raw1.jpg.html)

(http://i407.photobucket.com/albums/pp156/MOE-GUNZ-JACKSON/Raw2.jpg) (http://s407.photobucket.com/user/MOE-GUNZ-JACKSON/media/Raw2.jpg.html)
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 27, 2013, 07:23:28 PM
Title: Re: 550D raw video recording port official thread
Post by: jtkleine on May 27, 2013, 07:41:15 PM
Sorry if this is a stupid question, but I don't seem to be able to figure this out by myself. The resolutions that we are using with 550D -- are they 1:1 crops, or are they scaled down from some larger area of the sensor? I think I would prefer a 1:1 crop. I know the sensor has a bayer pattern, but still.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 27, 2013, 08:48:07 PM
Shawn_Lights, can you share which build you are using? I am getting only 19fps stable with the same reso
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 27, 2013, 09:05:53 PM
Shawn_Lights, can you share which build you are using? I am getting only 19fps stable with the same reso

I used this build: http://www.magiclantern.fm/forum/index.php?topic=5582.msg40579#msg40579

Auto ETTR Build. I have a 45mb/s Sandisk Extreme card.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 27, 2013, 09:49:07 PM
I used this build: http://www.magiclantern.fm/forum/index.php?topic=5582.msg40579#msg40579

Auto ETTR Build. I have a 45mb/s Sandisk Extreme card.

Hmm, I am using the same build, but my card is Toshiba 60mb/s. I should get another card..
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 27, 2013, 10:07:21 PM
Do you have global draw off etc?
Title: Re: 550D raw video recording port official thread
Post by: handbanana on May 27, 2013, 10:21:18 PM
My quick test

https://vimeo.com/67082496
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 28, 2013, 12:17:39 AM
My quick test

https://vimeo.com/67082496

Have you tried 1120x374?
Title: Re: 550D raw video recording port official thread
Post by: handbanana on May 28, 2013, 02:34:30 AM
No. At these resolutions RAW seems pretty useless to me. I also have a 60D so I have been messing with that more, but I figured I'd try the 550D. 60D DNGs revert to 5600 Kelvin in Adobe Camera RAW and sometimes exposure seems off, but it's at higher resolutions for longer (although not continuously at 1280 wide so still pretty useless imo).
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 28, 2013, 07:45:51 AM
Do you have global draw off etc?

Yes, I turn everything off
Title: Re: 550D raw video recording port official thread
Post by: prabhath.mp on May 28, 2013, 09:52:24 AM
Hi All,

This query might have been already answered however could anyone please let me know how safe is the new update (for recording RAW on 550D) http://www.mediafire.com/download/37ag5vd6z7mm4vj/ML_Raw_fps_ETTR.rar (http://www.mediafire.com/download/37ag5vd6z7mm4vj/ML_Raw_fps_ETTR.rar) - Has there been any update after this?

Can I use this on a 16GB Sandisk 30MB/s Class 10 card to record RAW?

Also, has anyone tried to copy these files from an Ubuntu operating system (13.04)? (I previously had Windows XP when I had copied version 2.3 to the SD card). Is the procedure still the same or would there be any compilation errors if I copy from any other operating system except Windows?

Sorry for asking too many questions but I am eager to know :)

Thanks for answering!

Cheers..
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 28, 2013, 10:29:58 AM
Guys! I'm so excited that it works on my 550D! Even at this low resolution, it's still a very cool filmic look! I had an idea though, what about B&W? Could we achieve higher resolutions in B&W? The files would be a third of the size (or so I'd imagine with only 1 channel)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 28, 2013, 10:31:02 AM
Here's my quick test http://vimeo.com/67112590

My workflow on Mac:

1) raw2dng
2) batch convert in RPP > tiff (16-bit L Perceptual)
3) Terminal : ffmpeg -f image2 -r 24 -i %6d.tiff -vcodec libx264 -preset veryslow -qp 0 -pix_fmt yuv420p movie.mkv

Think I will play with Automator to make a script which will automate the whole process. As you can see the clip is very short, because it stops as soon as 1 frame drops.. I can allow skipped frames, then it drops a frame or two occasionally..

EDIT: Forgot to mention that I also adjust color and exposure in RPP and save setting as directory default before loading all dng's
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 28, 2013, 11:45:50 AM
Ooh, that's pretty sweet. A very different look to regular h264. The low resolution makes it really soft, but the DR makes it sooooo filmic. I love it.

Ode to RAW:
If the 5D mkIII is the cine camera,
The 550D is the super 8 film maker!
Film is dead long live the Lantern

Shawn_lights those images are remarkably sharp! How many frames are you able to record in one shot? LV on or off?
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 28, 2013, 12:07:56 PM
This raw is kicking H.264's ass so hard it's almost funny. I just put together a little clip at 960x408 and I'd almost venture to say it appears sharper than the 1080 H.264.... I'll upload tomorrow, it looks very cool (with very little effort).
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 28, 2013, 12:17:37 PM
Looks like my Toshiba SD card is not stable, because sometimes I am able to capture quite a few frames in 960x408 @ 24fps, and next time it stops  immediately even at lower resolutions.
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 28, 2013, 12:31:52 PM
It seems like there's a spike in nessecary transfer rate right at the start which kills it for some of the higher resolutions. I wonder if there's a way to solve this?
Title: Re: 550D raw video recording port official thread
Post by: zenlenz on May 28, 2013, 12:35:29 PM
I've been playing with the first bin provided by mk11174 (thanks for that!) over the last couple of days. Even to my untrained, amateur eye the raw footage available to us now, beats that previous Canon mush we had to endure.

Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 28, 2013, 12:50:20 PM
It seems like there's a spike in nessecary transfer rate right at the start which kills it for some of the higher resolutions. I wonder if there's a way to solve this?

I noticed that too
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 28, 2013, 02:59:37 PM
This raw is kicking H.264's ass so hard it's almost funny. I just put together a little clip at 960x408 and I'd almost venture to say it appears sharper than the 1080 H.264.... I'll upload tomorrow, it looks very cool (with very little effort).

Is this using the Photo mode ie: no line skipping or 1920x1080 video mode with line skipping?

http://www.magiclantern.fm/forum/index.php?topic=5441.0 (http://www.magiclantern.fm/forum/index.php?topic=5441.0)

I've only tried it out so far with the later, should I be using Photo mode 1:1 crop, is it even available for 550D? Haven't had chance to try yet.  I'm using MK11147's builds. Cheers.

**EDIT**

Nevermind, sorted, been so long since I used any mode other than video I'd forgotten how to use Livemode in 'M' or any other photo shooting mode. Photo modes give waaaaaay better output than video modes. 1:1 crop vs line skipped.
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 28, 2013, 03:56:56 PM
Ooh, that's pretty sweet. A very different look to regular h264. The low resolution makes it really soft, but the DR makes it sooooo filmic. I love it.

Ode to RAW:
If the 5D mkIII is the cine camera,
The 550D is the super 8 film maker!
Film is dead long live the Lantern

Shawn_lights those images are remarkably sharp! How many frames are you able to record in one shot? LV on or off?

LV was on. I actually had to stop the recording. It was running continuously.
Title: Re: 550D raw video recording port official thread
Post by: bzhwindtalker on May 28, 2013, 08:22:26 PM
Hello guys, I'm new here, I just dowloaded and installed the custom raw firmware, my card is pretty shitty I can't even get continuous 940p, but I noticed I get repetabily +20% frames when I choose 720p60 from the canon menu VS 1080p24.
Can someone confirm this behaviour?
Thanks for the nice work guys!
Adam
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 28, 2013, 09:00:36 PM
Managed to squeeze out 30 frames of 720p @ 23fps

http://vimeo.com/67151500

406p @ 23fps (720x406) seems to be stable for me

http://vimeo.com/67151498
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 28, 2013, 10:24:35 PM
Hopefully the 10bit hack will help us get closer to full hd. We can only wish.
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 28, 2013, 11:18:02 PM
Hopefully the 10bit hack will help us get closer to full hd. We can only wish.
Sorry but even 10-bit won't solve the 21 Megabyte/s write speed issue. It should allow us to record 1280 X 550. That's a nice 21:9 aspect ratio.
 (1280 X 550 X 10 / 8 X 24 = 20 Megabye/s)

And once you 550D guys get the "SRAW" option back, you'll get at least continuous recording in 960 X 540 :D

Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 29, 2013, 12:27:39 AM
So, I'm gunna give it a go today. What build/components should I look for for 550D? Are there an install instructions for 550D yet or do I just follow 5D stuff?
Title: Re: 550D raw video recording port official thread
Post by: Shawn_Lights on May 29, 2013, 01:00:05 AM
So, I'm gunna give it a go today. What build/components should I look for for 550D? Are there an install instructions for 550D yet or do I just follow 5D stuff?

Go to the link I posted a few post back. Copy the bin file and the raw module folder.
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 29, 2013, 01:04:17 AM
Is this using the Photo mode ie: no line skipping or 1920x1080 video mode with line skipping?

http://www.magiclantern.fm/forum/index.php?topic=5441.0 (http://www.magiclantern.fm/forum/index.php?topic=5441.0)

I've only tried it out so far with the later, should I be using Photo mode 1:1 crop, is it even available for 550D? Haven't had chance to try yet.  I'm using MK11147's builds. Cheers.

**EDIT**

Nevermind, sorted, been so long since I used any mode other than video I'd forgotten how to use Livemode in 'M' or any other photo shooting mode. Photo modes give waaaaaay better output than video modes. 1:1 crop vs line skipped.

I was simply in video mode. I'll post up my results once I finish editing them. I'm not in love with the things I shot (stupid amounts of focus racking...) but the quality is great for "standard def"!
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 29, 2013, 05:58:42 AM
shawn_lights thanks for that I'm loosing track of where I see stuff in all these threads!

After recording some RAW I tried dropping the file on the rwa2dng.exe. It seems to run through all the images but doesn't render any out. I'm guessing they should end up in the root folder with the .exe (?), the app doesn't say the raw file is faulty or anything.

Has anyone else seen this behaviour. I thought it may have to do with the 550D raw files.

On windows machine.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 29, 2013, 07:37:09 AM
With MK11174's builds has anyone got 'Seperate WAV' working? I've switched it on in the audio menu rather than using 'Beep' although beep is useful to signal start and end of recording as I clear overlays on record but have no WAVs on the SD card.

Is Seperate WAV for recording to an external audio recorder? Anyone using an external audio recorder in any way with these raw builds?
Title: Re: 550D raw video test
Post by: nightvision04 on May 29, 2013, 07:52:01 AM
Here's my results with 960 x 360. I've upscaled the results to 1920 x 720 (2.66:1). I used Raw2dng.exe for conversion, then imported into After Effects with a low saturation color profile. Finally, it was colored in Resolve. Coloring was a great challenge. It probably would have been near impossible if I didn't use a flat color profile.

Many thanks to Alex and MK11147

Enjoy :)

Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 29, 2013, 09:24:34 AM
mm, dunno, looks quite grainy to my eyes. Perhaps needs higher bit rate export before uploading to youtube?
Title: Re: 550D raw video recording port official thread
Post by: nightvision04 on May 29, 2013, 09:30:50 AM
Hmmm. I upscaled to 1080p before uploading, so you won't see the preserved resolution with watching on 1080p. Perhaps that's it?

I'm sure you know this... But again, it's only 960 x 360p.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 29, 2013, 10:32:47 AM
my screen at 1600x900, 720p seems really sharp, 1080p looks smooth, I prefer to upscale to 900px, although it can only viewable on my screen and 720p, still having problems to upscale to 1080..

I think we must exchange our 550D with 50D..
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 29, 2013, 10:52:40 AM

And once you 550D guys get the "SRAW" option back, you'll get at least continuous recording in 960 X 540 :D
I already tried to enable SRAW, our camera gets Assert errors with it on, that is probably why Alex has it disabled in the regular builds, it actually is still on in the regular builds, but it is used in the the feature AutoBurst Picture Quality, if you turn that on while set to RAW in canon menu you get an Assert error with our camera. And that is if I turn it on to be used like on your cam with this 550D Raw Video build or when I use it with the new nightly builds, doesn't help us at all.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 29, 2013, 12:01:07 PM
Could someone clarify then this sRAW, is this the difference between line skipped video mode vs 1:1 crop photo mode?
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 12:46:53 PM
Getting odd sprinklies pixie dust on 720p mode using this hack

ML_Raw_fps_ETTR.rar


Tested up to 10gb , no frame outs, 1360 x 694 , 12fps, shutter override 1/48
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 29, 2013, 01:16:27 PM
Getting odd sprinklies pixie dust on 720p mode using this hack

ML_Raw_fps_ETTR.rar


Tested up to 10gb , no frame outs, 1360 x 694 , 12fps, shutter override 1/48

You have probably some bad pixels on the sensor: with normal video & photos they are masked in the canon firmware, but in ml raw not
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 29, 2013, 01:20:06 PM
Here's my little test video. Although I think I over did it with the bass in the music... a lot...  ::)

Title: Re: 550D raw video recording port official thread
Post by: Schmeknicolor on May 29, 2013, 01:34:25 PM
Just something that may have some sense...

People already noticed that changing to 720p in the Canon menu results in more frames captured, to me that means that the cpu and memory are still working out the original h264 video processing. Does this makes sense?
If it does, what about try to disable this or get a way of recording the raw video while in a photo mode?
It would free the cpu and memory.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 29, 2013, 01:40:13 PM
Could it be that in 720p mode the captured area is actually smaller? That would explain the higher amount of frames. The picture I get in 720p mode is much grainier and noisier than in 1080p mode.
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 01:41:04 PM
No bad pixels on sensor!

Its the same issue on 600d that was fixed

see spinkle fix build 600d...

You have probably some bad pixels on the sensor: with normal video & photos they are masked in the canon firmware, but in ml raw not
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 29, 2013, 02:10:46 PM
No bad pixels on sensor!

Its the same issue on 600d that was fixed

see spinkle fix build 600d...

Good to know ! Now I post this problem in the "state-of-the-art" head post of this thread ! Many thanks for your signaling !  :)
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on May 29, 2013, 02:18:51 PM
Hi guys,

I'm just catching up with this topic. So my question might not make much sense.

Would this allow to create a non-raw cropped mode for the 550d? I assume buffer and card speeds will not be able to cope with 720 or 1080 raw frames, but is it possible to compress them and still select the area that is being recorded?
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 02:47:38 PM
Hints for 550D users

1 Record 12 FPS and use Twixtor to 24 FPS -- see what Twixtor can do here
https://vimeo.com/54986947#

2 Record 720P mode and scale height by 1.66x -- 720P mode has pixel aspect ratio embedded

3 Record with 2x scope at 12 FPS, tested with 1360 x 694 for 2.35 and 1440 x 694 for 2.48
Stretch 1360 x 694 to 1632 x 694 (2.35) and 1440 x 694 to 1728 x 694 (2.48)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 29, 2013, 03:16:20 PM
3 Record with 2x scope at 12 FPS, tested with 1360 x 694 for 2.35 and 1440 x 694 for 2.48
Stretch 1360 x 694 to 1632 x 694 (2.35) and 1440 x 694 to 1728 x 694 (2.48)

I did not get that.. what do you mean?
Title: Re: 550D raw video recording port official thread
Post by: CFP on May 29, 2013, 03:28:20 PM
Could someone clarify then this sRAW, is this the difference between line skipped video mode vs 1:1 crop photo mode?
There's a feature in the newest Magic Lantern builds that allows you to change the picture quality for photos inside the Magic Lantern menu.
Usually this is only possible in Canon menu. You know, that are the settings like "L" (For Large JPEGs) or "RAW+L" (For Large JPEGs and Canon raw pictures).
And since the Rebel line had only one size for raw pictures, ML added two more sizes: MRAW and SRAW (Medium and Small). They don't work properly but they affect the size of the buffer. And that's the important thing: The normal size of the buffer is 68 Megabyte. With MRAW it's only 36 Megabyte but with SRAW it becomes 96 Megabyte. And with a bigger buffer you can record more frames, even in higher resolutions.

SRAW has nothing to do with crop modes. And it doesn't affect the image quality of the raw videos. It only increases the size of the buffer.

But when SRAW doesn't work on your cameras then 1% probably was right when he said that the 550D is actually the worst camera for raw video. But don't worry, 600D is the second worst :P

And keep in mind that when shooting in Canon's 720p mode you'll get even more aliasing than in 1080p or 480p mode since it has even more line skipping. It's only usefull if you want to get as much width as possible to keep the crop factor small.
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 03:40:05 PM
use a 2x anamorphic lens  ;)


I did not get that.. what do you mean?
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 03:44:56 PM
Using a 2x scope reduces this effect, since the sensor effectively sees a 2x vertically stretched image



At keep in mind that when shooting in Canon's 720p mode you'll get even more aliasing than in 1080p or 480p mode since it has even more line skipping. It's only usefull if you want to get as much width as possible to keep the crop factor small.
Title: Re: 550D raw video recording port official thread
Post by: pooli on May 29, 2013, 04:08:54 PM
Please tell me, is the ability to record full RAW on the 550d in the future, we can hope for it, or is it maybe never?
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 29, 2013, 04:18:39 PM
Hints for 550D users

1 Record 12 FPS and use Twixtor to 24 FPS -- see what Twixtor can do here
https://vimeo.com/54986947#

2 Record 720P mode and scale height by 1.66x -- 720P mode has pixel aspect ratio embedded

3 Record with 2x scope at 12 FPS, tested with 1360 x 694 for 2.35 and 1440 x 694 for 2.48
Stretch 1360 x 694 to 1632 x 694 (2.35) and 1440 x 694 to 1728 x 694 (2.48)

you're just speaking theoretically, please do it and share the result with us. we're all burning time on our 550Ds here.
Title: Re: 550D raw video recording port official thread
Post by: qsara on May 29, 2013, 04:21:00 PM
Please tell me, is the ability to record full RAW on the 550d in the future, we can hope for it, or is it maybe never?

full-what? full-hd? yeah its impossible with 14bit raw at 20MB/s record rate.

we're already capturing 24fps 960x320px RAW Video on 550D, an it up-scales easily to 720p.
Title: Re: 550D raw video recording port official thread
Post by: al vilar on May 29, 2013, 05:17:43 PM
Can anyone provide me the latest nightly link for 550d raw to test?

Thanks
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 29, 2013, 06:17:03 PM
here is what i havent figured out.
does raw recording work the same way foe every canon eos camera?
you set the resolution and you get a crop of a line skipped  frame?

all i can do with my 550d is record small resolutions cropped but some people here are comparing  h264 1080p full sensor videos with upscaled sub1080p resolution0s. but the fov is the same. even with 550d.
how do they do that?
Title: Re: 550D raw video recording port official thread
Post by: aombk on May 29, 2013, 06:25:08 PM
i guess what im trying to ask is, can we record full sensor raw? (no matter what resolution)
5d3 does that and with resolution close to full hd, right?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 29, 2013, 06:56:50 PM
No bad pixels on sensor!

Its the same issue on 600d that was fixed

see spinkle fix build 600d...

I tried to search the forum for this 600d fix, but I cannot find it. Can you give a link ? So I can try to port the fix into 550d also ! Many thanks !  ;)
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 07:24:09 PM
I used the one from this page

https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads
[600D] Still Sprinkle Free.zip   281.4 KB   2013-05-27   153


I tried to search the forum for this 600d fix, but I cannot find it. Can you give a link ? So I can try to port the fix into 550d also ! Many thanks !  ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 29, 2013, 07:34:13 PM
I used the one from this page

https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads
[600D] Still Sprinkle Free.zip   281.4 KB   2013-05-27   153

Thanks. Unfortunately it's a compiled version. I need the sources of this version, but i cannot find them inside the commits. Do this correction was already merged into the official ML nightly build ? If yes, I can check in the official repository current sources.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 29, 2013, 07:51:37 PM
Thanks. Unfortunately it's a compiled version. I need the sources of this version, but i cannot find them inside the commits. Do this correction was already merged into the official ML nightly build ? If yes, I can check in the official repository current sources.
Same here, I see he included a bin file so I dont know if there are any changes that need to be done to the source too besides just replace the rec_raw.mo and magic.sys file included. I havent had a chance just to try it, I will try with the latest source once I get a free chance for sure.
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on May 29, 2013, 08:39:01 PM
Maybe you can find the info from user 1% ?

Thanks. Unfortunately it's a compiled version. I need the sources of this version, but i cannot find them inside the commits. Do this correction was already merged into the official ML nightly build ? If yes, I can check in the official repository current sources.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 29, 2013, 10:42:01 PM
There's a feature in the newest Magic Lantern builds that allows you to change the picture quality for photos inside the Magic Lantern menu.
Usually this is only possible in Canon menu. You know, that are the settings like "L" (For Large JPEGs) or "RAW+L" (For Large JPEGs and Canon raw pictures).
And since the Rebel line had only one size for raw pictures, ML added two more sizes: MRAW and SRAW (Medium and Small). They don't work properly but they affect the size of the buffer. And that's the important thing: The normal size of the buffer is 68 Megabyte. With MRAW it's only 36 Megabyte but with SRAW it becomes 96 Megabyte. And with a bigger buffer you can record more frames, even in higher resolutions.

SRAW has nothing to do with crop modes. And it doesn't affect the image quality of the raw videos. It only increases the size of the buffer.

But when SRAW doesn't work on your cameras then 1% probably was right when he said that the 550D is actually the worst camera for raw video. But don't worry, 600D is the second worst :P

And keep in mind that when shooting in Canon's 720p mode you'll get even more aliasing than in 1080p or 480p mode since it has even more line skipping. It's only usefull if you want to get as much width as possible to keep the crop factor small.

CFP thanks for such a detailed reply. Regarding the buffer size, if buffer is 'Shoot malloc total' yes I see 68MB. Cheers for the explanation.

Title: Re: 550D raw video recording port official thread
Post by: notdabod on May 30, 2013, 03:29:54 AM
full-what? full-hd? yeah its impossible with 14bit raw at 20MB/s record rate.

we're already capturing 24fps 960x320px RAW Video on 550D, an it up-scales easily to 720p.

WOW!

Would you please share your steps to getting RAW working on 550D?

I think we can assume that everyone has the last firmware from canon and ML, but what next?

I did get RAW working on my friends 5dM2, is it as simple as that?

Just drag and drop the right files from the link below on the SD card and reformat?

https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads

Thanks
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 30, 2013, 03:42:01 AM
I managed to get my camera to crash shooting RAW. Just dropped battery and I was good to go. I noticed that I have to setup the RAW feature in video shoot mode, then shoot in photo mode. At the end of a recording using 1:1 ratio the camera hung and created a error file. I guess I should pass this on, but I'm not sure if the core Devs are interested at this early time of 550D implementation.

I gather there is no way to get full FOV due to memory restrictions. So there are no additional line skips available? Grateful that there are at least an overlayed shooting box :)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 06:19:42 AM
I managed to get my camera to crash shooting RAW. Just dropped battery and I was good to go. I noticed that I have to setup the RAW feature in video shoot mode, then shoot in photo mode. At the end of a recording using 1:1 ratio the camera hung and created a error file. I guess I should pass this on, but I'm not sure if the core Devs are interested at this early time of 550D implementation.

I gather there is no way to get full FOV due to memory restrictions. So there are no additional line skips available? Grateful that there are at least an overlayed shooting box :)
No, cant really even worry about crashes using Raw Rec, cause this build is just a build for us to at least use it. The only stable release you can count on is the full build which does not include Raw Rec because of memory issues.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 30, 2013, 07:17:59 AM
I managed to get my camera to crash shooting RAW. Just dropped battery and I was good to go. I noticed that I have to setup the RAW feature in video shoot mode, then shoot in photo mode. At the end of a recording using 1:1 ratio the camera hung and created a error file. I guess I should pass this on, but I'm not sure if the core Devs are interested at this early time of 550D implementation.

I gather there is no way to get full FOV due to memory restrictions. So there are no additional line skips available? Grateful that there are at least an overlayed shooting box :)

3point, use video mode for raw, forget photo mode, it doesn't offer 1:1 vs line skipped, I was mistaken, only 5DIII has that option so far I think.

I'm getting continuous using 960x540 at 2.35:1 (960x408) with a Sandisk Extreme Pro 95MB/s although max is about 21.5MB/s through SD controller. I have Global Draw on, the scopes, peaking and zebras then clear overlays automatically when recording and drew a small box on an LCD sticky screen protector for the white rectangle to help framing.

Yeah for sure, a build that could keep the framing box on but all other stuff off when recording and not have to keep navigating through resolution and aspect ratio every time switch camera back on, being able to set a default res and ar would be useful. :-)
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 30, 2013, 07:49:42 AM
Hmmm, I seem to have the framing box in photo mode?

All a bit of a sore point as I cannot get raw2dng to work anyway. So all I have seen are black and white previews :P
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 30, 2013, 08:08:14 AM
raw2dng.exe is a command line tool? So you could fire up a terminal with Run cmd from your Windows start menu, change directory to your raws and raw2dng exe with cd whatever then type raw2dng M000000.RAW, hit return and that should do it. Otherwise could try one of the batching tools from the Post Pro thread?
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 11:52:23 AM
so.. 550d seems to be useless for raw, because in order to compare it to a hacked Lumix GH2 it needs to record at least in the same resolution.
Title: Re: 550D raw video recording port official thread
Post by: Videoteq on May 30, 2013, 01:31:31 PM
"raw2dng.exe is a command line tool? So you could fire up a terminal with Run cmd from your Windows start menu, change directory to your raws and raw2dng exe with cd whatever then type raw2dng M000000.RAW, hit return and that should do it. Otherwise could try one of the batching tools from the Post Pro thread?"

On my Win 7 and Win 8 pc's I simply drag the raw file and drop onto raw2dng.exe and it produces all the dng's into the same directory as the raw2dnd.exe file. It's really quick too.

Unable to experiment on my 550D just now as I'm away till the weekend with other camera gear. Looks like good progress is being made though. I have a BMPCC on order so I won't be buying a 50D, but the 550D could be useful for green screen work maybe.


Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 01:44:12 PM
For anyone wondering about the white rectangle and constant bitrate, these features are all enabled in the later release I posted with EttR and Crop in it, http://www.magiclantern.fm/forum/index.php?topic=5582.msg40875#msg40875  I see the Raw rectangle as I record Raw, if this is the rectangle you mean, maybe you need to clear your ML config file, it is loaded and works. Let me know if this is the one your talking about.

I also get 960x408 at 24fps regardless if I turn global draw and any other feature off, so you should be able to keep everything on that is enabled for the release. Hack mode does seem to stop the skipping with 960x408, it always skips after 72 frames 1st try but the 2nd and next tries till I reboot cam all are no skip. I use 45 MB/s sandisk extreme and yes, only get max 20-21 mb/s cause that is as fast as the cameras controller will record no matter how fast your card is.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on May 30, 2013, 01:46:20 PM
Yes the white rectangle is the one I meant and that is the build I am using too. The rectangle matches recorded result in photo mode, but not video mode (I think).
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 01:52:21 PM
Yes the white rectangle is the one I meant and that is the build I am using too. The rectangle matches recorded result in photo mode, but not video mode (I think).
I always use video mode, but your saying its there but does not match what your recording, I will have to check now. This kind of stuff I wont be able to fix if it is a bug cause this has nothing to do with memory or the features I have enabled, I have not messed with the Raw Rec module this is from the latest unified build from the stable release, alls I did was turn features off that are not used much to get more memory, non of that will effect how Raw Rec works.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 02:03:40 PM
Hmm, no issues in video mode, I just tested it and the rectangle is right on target for 960x408, is that the res you are using?

On target in photo mode as well at least while I have rectangle centered, did not try moving rectangle, but I know panning feature works when I use it to move rectangle and video recorded follows rectangle.

One thing I noticed, recording in video mode is more stable, very hard to keep from skipping frames in photo mode, I see no reason to use photo mode, video mode seems best while using Raw Rec. No skips using 960x408 except very 1st try.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 30, 2013, 02:32:48 PM
For anyone wondering about the white rectangle and constant bitrate, these features are all enabled in the later release I posted with EttR and Crop in it, http://www.magiclantern.fm/forum/index.php?topic=5582.msg40875#msg40875  I see the Raw rectangle as I record Raw, if this is the rectangle you mean, maybe you need to clear your ML config file, it is loaded and works. Let me know if this is the one your talking about.

I think a little bit of misunderstanding here between the three of us. :-)

The white rectangle in raw record is the feature in question, but when testing what to switch on and off during recording to get a continuous 960x408 I found 'Clear Overlays' when recording solved drop outs, so I'd use focus peaking, zebras, white rectangle and raw histogram to compose and expose then when hitting record overlays were cleared, but of coarse this removed the white rectangle. :-( 

So to be able to switch off focus peaking, zebras and histogram when hitting record but leave white rectangle on might hopefully still prevent drop outs but give a framing target, currently I just drew a rectangle on a clear LCD protector with an indelible ink pen :-)

Quote
I also get 960x408 at 24fps regardless if I turn global draw and any other feature off, so you should be able to keep everything on that is enabled for the release. Hack mode does seem to stop the skipping with 960x408, it always skips after 72 frames 1st try but the 2nd and next tries till I reboot cam all are no skip. I use 45 MB/s sandisk extreme and yes, only get max 20-21 mb/s cause that is as fast as the cameras controller will record no matter how fast your card is.

I tried leaving overlays on and got dropped frames with a 95MB/s card (21.5MB/s controller max)

Regarding setting raw resolution in the menu it would be really good to set a default to 960x408 but it doesn't save in config, so every shot when turning cam back on we have to switch the resolution back from 1754x??? whatever it is, even though the 550D just isn't capable of that resolution anyway.

Obviously I'm not complaining, this is alpha experimental and I'm very grateful to you for the builds, we all are but would be great to smooth out some of the fiddling in camera.

On a positive, I too looking forward to trying out the tracking (panning) feature. :-)

I added to the confusion in an earlier post about photo mode vs video mode, CFP put me straight, bottom line no point using photo mode unless on a 5D MKIII. http://www.magiclantern.fm/forum/index.php?topic=5494.375 (http://www.magiclantern.fm/forum/index.php?topic=5494.375)

It doesn't make any difference in picture quality and it should make no difference in performance. But in photo mode you can't set ISO, aperture and shutter speed manually. Sure, you can change the numbers but the actual aperture doesn't move if you change the number on the display.

So: For manual exposure control, record in Movie Mode.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 02:43:06 PM
Someone mentioned line skipping. Would it be possible to take use just the center of the sensor to avoid line skipping? Just like GH2 does in EX. Tele Conv. mode ?
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on May 30, 2013, 02:52:57 PM
Someone mentioned line skipping. Would it be possible to take use just the center of the sensor to avoid line skipping? Just like GH2 does in EX. Tele Conv. mode ?

It was me mention line skip vs crop, photo mode vs video mode. I'd read a how to by RenatoPhoto on how to do a crop mode using the 5D3 but can't find the post now.

**EDIT** Found It.

http://www.magiclantern.fm/forum/index.php?topic=5451.0 (http://www.magiclantern.fm/forum/index.php?topic=5451.0)

OOPs no this one. :-)

http://www.magiclantern.fm/forum/index.php?topic=5441.0 (http://www.magiclantern.fm/forum/index.php?topic=5441.0)

The beauty of this video is that there is ZERO loss of detail when compared to a photo taken a full resolution.  Of course the photo covers the entire size of the sensor 5760x3840 pix while the video is just a small portion of the sensor in my case I am generating a video of 1920x1080 pix.   There is no down-sampling of the sensor so the image is a 1:1 crop.

Since we are using 1920 pix out of the 5760 pix (width) the zoom factor is 5760/1920 = 3X.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 02:58:39 PM
aha, so choosing x5 zoom will do just that, right? Cool! Maybe I will finally get less frames skipped!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 05:33:00 PM
Interesting results. With new stable build, after disabling the same features from I did in the other builds, the mem was not enough because with the new stable build they added in flexinfo, so I have to turn a few more things off to make raw rec work, but when it does work, I can now get 960x480 stable with no skips. I was only able to get 960x408 before, I also noticed the malloc mem is now 31M / 75M  not 28M / 68M anymore. So we have more me which makes us able to get 960x480 Not sure what was changed that effected our memory, alls I see new is the flexinfo stuff.

Ok, update: Well it is not stable build that changed the memory, U just tried it without an modifications and it shows 28M 68M so whatever gave more memory was one of the features I turned off to get raw rec to work with the new stable source/ aka Nightly build. So now I need to track down what is gave more memory.

The new nightly builds is not helping us much with Raw Rec though since we have to turn off more features to get it to run, so maybe I can stick with the source I have been using and see if I can get more mem from that one this way we don't lose anymore ML features then we already did.

Update:2 Well it seems it is in the source, something changed from the last nightly build, cause wth the last nightly we get lower memory, with the latest changeset we get more memory, so maybe the fix 1% came up with.

Ok, say we can thank 1% for his tweak to exmem which got us more memory to use 960x480 stable, I confirmed afte going back a few changesets to the one he tweaked that it is the one that did it.

Now to add this change to our old source so we dont lose more features.
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 30, 2013, 06:46:49 PM
@mk11174: If you need a tester ;) for the build which gives you 960x480 stable, please count me in. Link? Thanks!

Best,

NedB

P.S. All this attention to the "20MB SD Controller limit" makes me think of the days when the idea of getting raw video out of a DSLR was a complete joke. Something tells me this too shall pass and one of the devs or another genius lurking in the shadows will figure out a way of allowing the DSLR's with "slow" SD Controllers to nevertheless approach 1920x1080. Put it this way: I wouldn't bet against these guys!
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 06:57:28 PM
mk11174, can you share the build you run stable at 960x480? I did not quite understand what I need besides the latest nightly...
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 30, 2013, 07:04:30 PM
@pavelpp: You don't need the latest nightly. mk11174 used the latest changeset (even newer than the latest nightly) to compile his latest build, with which he was able to get 960x480 stable. If mk11174 decides to share this build or a variation of it, my experience is that you won't need anything but what he shares (of course your SD card must be bootable). Cheers!
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 07:26:10 PM
@NedB, cool! Meanwhile I ran some side by side tests of my Lumix GH2 with 100Mbps hack (1080p@29.97fps) and 550d at 1200x400@18fps raw and I see that Canon is not even close in terms of details.. Maybe I am not doing post processing properly? I convert with raw2dng, then export dng's to 16 bit tiff and then encode with ffmpeg using lossless libx246... One thing I noticed is that my video suffers from magenta

see the result http://l.bitcasa.com/MhTBidmb

Title: Re: 550D raw video recording port official thread
Post by: gopzchile on May 30, 2013, 07:33:12 PM
Anybody can upload the last version of ML to shoot in raw? Thank!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 08:10:56 PM
Don't worry, I will share, I am just trying to get as many things activated as possible with the new source, I promise I will upload it soon with all the files you need.
Title: Re: 550D raw video recording port official thread
Post by: gopzchile on May 30, 2013, 08:27:59 PM
Thank you very much mk11174!
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 30, 2013, 08:29:12 PM
@mk11174: Thanks a lot for your hard work. We are certainly victims of the old (Chinese?) curse: May you live in interesting times...

Cheers!
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 30, 2013, 08:45:32 PM
I had a thought recently that I am unsure will have an impact.

I know the most recent stable build of ML latern has a bitrate adjustment. So instead of 14, my assumption was that we could adjust that to .7x (which if my math is correct is a little less than 10).

Does it not work that way? Or with smaller data rate will there be more chance of dropped frames? (I know if I don't encode my videos with a large enough data rate, there is/was a chance of "skipping")

Just a thought/query. Forgive me if any of my information is wrong or if this is off-track.
Title: Re: 550D raw video recording port official thread
Post by: NedB on May 30, 2013, 08:55:58 PM
@telecastDaveRI: As far as I know, the bitrate adjustment in ML applies to the final H.264 encoding, and wouldn't apply at all to getting raw video out of the DSLR. In other words, the data rate for raw (at 14-bit) is what it is, proportional to the dimensions of the video. The raw hack doesn't do any processing (other than cropping) of the camera-provided raw feed, so there is no place in this chain of events to apply the .7x throttle you are suggesting. Apparently other devs and assorted brainiacs are working on reducing the number of bits of raw data written to the SD card from 14 to 12 or 10. This would have a slight effect on the bitrate (either 12/14, about 15% less, or 10/14, about 29% less), and get us from the currently stable 960x408 (or 480, as mk11174 has just informed us) up to the next step or so on the ladder (1120xwhatever). So if we are willing to accept less color fidelity, we can get a slightly sharper picture. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 30, 2013, 09:08:38 PM
Very well explained NedB - I wasn't sure.

Here's to hoping they can figure it out. At the end of day, it doesn't matter if we can record raw video on these cameras at 1080p, for example, as they were never designed to do that anyway. It is just amazing that we can do it at all!!

That being said, it still does give us something to strive for!! ya never know...

and thanks again for the info.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 09:13:00 PM
I kept on as many things as I could with the updated source with the flexinfo added, I wanted us to have the most recent updated source so I just made that one work for us, we will have the main features, at least the things I think we need with Raw Rec, if we want other features, those really have nothing to do with Raw Rec so best to use another Bin without Raw Rec.

If 960x480 does not work for you first try, dont give up, it usually works 2nd try and on.

Hacked mode does not seem to help.

Use Video mode, works best.

I notice wav recording does work in Raw Rec, it does create wavs fine even though we get a crash report, but this doesnt seem to be with Raw Rec, cause I see we get same error just trying to Record wav file in the Audio Menu without Raw Record on at all. I just kept recording with crash on screen, it still made new wav files, but probably best to not even use it, use a portable audio recorder like whats best for FPS feature.

The only Direct Draw feature that seemed to effect Raw Rec at 960x480 was focus peaking, but not always.

I see they still did not make a way to save Raw Rec settings like how other settings are saved.

http://www.mediafire.com/download/9agq38cf5mafb3c/ML_960x480_Raw_Rec.rar

Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 30, 2013, 09:47:01 PM
nice one mk11147;-)

i got 1280*480 19 fps without skipping...now my batts run out >:(

i put all my hope in a 12 or 10 bit mode.

big applaus for you developing guys!!!

tomorrow i will make more test.
Title: Re: 550D raw video recording port official thread
Post by: antoinecormier on May 30, 2013, 09:49:37 PM
Thanks again mk11174 !

Would It be possible to use this build with the previous raw rec (ML_Raw_fps_ETTR contains it !) ?
It had some pretty cool features (such as deleting RAW videos, and first and foremost, It had much more resolutions choices !).
It could be awesome, if the new build would let us do 1100ish resolution without having to use FPS override..

I've tried to use the new .bin with the previous raw rec but the module wasn't able to load.

I might be misunderstanding. Don't blame me ! :)

Have a nice day/night all !

(and once again, I apologize for my pretty weak english  :-[ )


Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 10:31:36 PM
trying it now! 720p @ 12fps
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 30, 2013, 10:35:11 PM
@pavelpp 720p @12fps....continuous? (I assume)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 10:39:08 PM
1 skipped frame in the beginning, then continuous. I stopped it after 1000 frames

UPDATE: 960x544 (16:9) @ 20fps continuous

I would prefer a 1200 width option back, jumping from 960 to 1280 is a bit too much, maybe even something in between would not hurt.
Title: Re: 550D raw video recording port official thread
Post by: hethfilms on May 30, 2013, 10:54:09 PM
Hey everyone! Just tested mk11174´s latest version. Best I could squeeze out of it was 1280x544 (2.35) @18 fps continuos. That´s already pretty awesome. I´m amazed how great and clean you still can get the picture even in low light. Was using an old 50 mm 1.4 lens.

I´ve tried bringing the clip to 24 fps using After Effects CS6 time remapping and interpolation, it actually was flawless, but of course it´s really time consuming. If we can bring it to 720p cinescope (2.35) @ 24p I´d be more than satisfied with that. It would actually be unbelievably cool to see something like that from a little consumer camera like the 550d. :)

I can also second that 720p (1280x720) @ 12 fps works, first try skipped frames, second try flawless continous shooting. That way you can just half the speed of the clip and use pixelmotion in After Effects to get 24p, although still not the real deal of course ;)

Oh yes I was using a SanDisk Extreme Pro SDHC UHS-I 8 GB card with 95 mb/s (I know probably overkill, but I just wanted to make sure, that the SD card is not the bottle neck here...)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 11:02:23 PM
I would prefer a 1200 width option back, jumping from 960 to 1280 is a bit too much, maybe even something in between would not hurt.
No prob, I will try to add back in the raw_rec module from before and compile it in to get the other module menu for raw rec, I to thought it was cooler, better to test with source mostly left untouched first, but since it works I will try to add that back in for sure.

By the way, BIG thanks to 1% for getting more mem out of the main source! Only thing that help us with this build even if we had to lose a few features, but nothing important at least.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 11:03:39 PM
btw, raw playback in camera crashes it - have to pull out the battery.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 30, 2013, 11:06:01 PM
btw, raw playback in camera crashes it - have to pull out the battery.
I am sure it will crash doing that, the new source added a few things that used up more of our memory so we are back at the border line again. But at least we get bigger size with Raw Rec!

Maybe when I add back in the last module from last build, maybe it will work better.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 30, 2013, 11:21:34 PM
Thanks mk11174! Will continue experimenting tomorrow.. now off to bed..
Title: Re: 550D raw video recording port official thread
Post by: zenlenz on May 31, 2013, 12:19:44 AM
Many thanks for the updated bin, mk11174. I'm still playing with the first one!

Latest little test was with panning mode...



I'm wondering if anybody has had the same thoughts, regarding the possible slowing down of the action, of this feature?
Title: Re: 550D raw video recording port official thread
Post by: intrinsic on May 31, 2013, 02:38:05 AM
Hi, guys!
Managed to test the latest release from mk11174.

Was able to get pretty stable 1728x576@12fps.
For me 12fps twixtored to 24fps is a good deal for the most cases I need.

Details:

- Movie mode, 1280x720@60fps or 640x480@60p
- Global draw off
- SanDisk ExtremePro 8Gb 45MB/s
- Photo Quality set to JPEG S (don't know if it affects anything)


Using previous build I've got 55Mb of free buffer cache, with the last one it was 62.
I've noticed also that at some magic point I became able to write normally at about 20MB/s, as earlier it was no more than 9-10MB/s.

About difference between RAW and standard H.264 Canon video.
For me it's mostly about noise and dynamic range which is goddamn good at low-light shooting and high contrast scenes.
So far I haven't been able to see a huge difference in detail and sharpness between 1080p H.264 and upscaled RAW I've got from 550D.
Hope with the higher stable resolutions it will become obvious )
So for now, the main feature here which makes it worth the all the efforts, is ability to get clean picture with more film-like noise especially in shadows and underexposed areas. Because trying to get the same picture in terms of shadow/highlight as I've got with RAW footage, using H.264, will result a huge digital-looking noise at shadows, especially terrific at ISO rates higher than 400.

Once again, god bless ML team and mk11174!
From Russia, with love!


Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 02:51:57 AM
I'm cheesing on the features that have to be turned off are u talking waveform if I can have waveform and raw that would be the only features I'd need on to be honest. On raw how Mitch control will it give u? Is it true raw or some mimicking of it
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 31, 2013, 04:17:33 AM
I'm cheesing on the features that have to be turned off are u talking waveform if I can have waveform and raw that would be the only features I'd need on to be honest. On raw how Mitch control will it give u? Is it true raw or some mimicking of it
Ok, I will see if it will still work with those turned on, no problem! 8]
Title: Re: 550D raw video recording port official thread
Post by: andjarnic on May 31, 2013, 06:14:32 AM
Hi all,

I can't seem to find anything related to how the resolution is being achieved. I read "crop" but my question is, what I see in the LCD is being recorded and resized to the 960x540 for example? Or is the 960x540 a small subset of what is visible? I assume the entire image in the LCD is resized so that you are getting what you see?

Is the new ML code basically taking the full sensor RAW image, and "cropping" (resizing?) it?

I assume the reason we're limited on resolution is the 21MBp/s limit of the SD card? Or is the processor not fast enough to handle a 1920x1080 pull?

Sorry, trying to get my head around how this works.. my camera is out of commission right now, so can't test anything out.
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 31, 2013, 08:13:06 AM
The limitation is card speed. Run a card benchmark and you'll see.
Title: Re: 550D raw video recording port official thread
Post by: cinedude on May 31, 2013, 08:27:15 AM
From what I've heard. The T2i can't write at certain card speeds because of the buffer. Which means we're limited to around 25MB/sec right?

Sorry if it's noobish, I haven't read every single post yet.
Title: Re: 550D raw video recording port official thread
Post by: LeviBetz on May 31, 2013, 08:29:03 AM
Is it true raw or some mimicking of it

Yep, true raw!
Title: Re: 550D raw video recording port official thread
Post by: cinedude on May 31, 2013, 08:41:46 AM
Hi all,

I can't seem to find anything related to how the resolution is being achieved. I read "crop" but my question is, what I see in the LCD is being recorded and resized to the 960x540 for example? Or is the 960x540 a small subset of what is visible? I assume the entire image in the LCD is resized so that you are getting what you see?

Is the new ML code basically taking the full sensor RAW image, and "cropping" (resizing?) it?

I assume the reason we're limited on resolution is the 21MBp/s limit of the SD card? Or is the processor not fast enough to handle a 1920x1080 pull?

Sorry, trying to get my head around how this works.. my camera is out of commission right now, so can't test anything out.

When recording with RAW, there's a little window that shows you the frame in the liveview. It's cropping the visible LCD to a tiny portion in the middle. It's as if you're shooting with a smaller sensor camera.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on May 31, 2013, 08:44:36 AM
My today's test 1728x576@12fps

http://youtu.be/6b3U9cR6ACU
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 12:50:20 PM
Excuse me, boys, but we programmers must solve the boot memory allocation problem, so no more double .bin is needed...

Look at what was done to boot-hack.c and 600D consts.h
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/all

Its booting into allocate pool and uses 640K bins. Just have to find the addresses in 550D firmware.

Do you mean HIJACK_CACHE_HACK and his addresses in 600D consts.h ?!?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 02:03:56 PM
Ok, I collected some info around the forum about this problem and I updated the head post, just in case someone is interested to help out. And now I need now some info to proceed :

Where to find the 550D rom disassembled, or where to find the rom dump and how to disassemble it ? Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 02:14:39 PM
here an attempt of real 2500*1080 on my 550d

using panmode in 5*zoom.and merged 6 clips to 2500*1080 totally useless:-)

but when it will be possible to run 2 rawrecmodules simultainlesly on faster 5dm3 than it could be possible.

what would you think?

https://vimeo.com/67377902
Title: Re: 550D raw video recording port official thread
Post by: sonic on May 31, 2013, 02:39:41 PM
Where to find the 550D rom disassembled, or where to find the rom dump and how to disassemble it ?

When you run 550D-109.fir, the following happens:
Code: [Select]
    f = FIO_CreateFileEx(CARD_DRIVE "ML/LOGS/ROM0.BIN");
    if (f != (void*) -1)
    {
        bmp_printf(FONT_LARGE, 0, 60, "Writing ROM0");
        FIO_WriteFile(f, (void*) 0xF0000000, 0x01000000);
        FIO_CloseFile(f);
    }
    msleep(200);

    f = FIO_CreateFileEx(CARD_DRIVE "ML/LOGS/ROM1.BIN");
    if (f != (void*) -1)
    {
        bmp_printf(FONT_LARGE, 0, 60, "Writing ROM1");
        FIO_WriteFile(f, (void*) 0xF8000000, 0x01000000);
        FIO_CloseFile(f);
    }

You can disassemle them with disassemble.pl (http://magiclantern.wikia.com/wiki/GPL_Tools#GPL_scripts_from_CHDK)
What I don't understand yet: 1% does for the 600D:
Code: [Select]
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR 0xFF0123E8But with the offsets from above, I dont't have such high addresses in my ROM?.BIN.dis
It's mirrored (http://magiclantern.wikia.com/wiki/Memory_map#QEMU).
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 02:51:46 PM
What I don't understand yet: 1% does for the 600D:
Code: [Select]
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR 0xFF0123E8But with the offsets from above, I dont't have such high addresses in my ROM?.BIN.dis

Many thanks for your hints ! Are you also working on this problem on 550D ? If yes, you can take hints on the head post of this thread, and if you have more hints to give, you can write them here so I will add them to the head post, many thanks !
Obviously you can tell me to modify-correct-integrate the infos that are already present there !

For your question: are you sure it's an offset (relative address) or perhaps it's an absolute address ?
Title: Re: 550D raw video recording port official thread
Post by: sonic on May 31, 2013, 03:07:56 PM
Are you also working on this problem on 550D ?

Yes, but first I want to be able (again) to install my (supposedly many) test builds via USB (http://www.magiclantern.fm/forum/index.php?topic=5915.0). I'll have to find Alex's source code for his ptp-ml.c implementation.

are you sure it's an offset (relative address) or perhaps it's an absolute address ?

Each .BIN is 0x0100 0000 = 16 MB long, so:
ROM0.BIN: 0xF000 0000..0xF0FF FFFF
ROM1.BIN: 0xF800 0000..0xF8FF FFFF

I think the #define is absolute.
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on May 31, 2013, 03:38:33 PM
My first test.


Thank you guys for this amazing feature!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 31, 2013, 04:07:05 PM
You can disassemle them with disassemble.pl (http://magiclantern.wikia.com/wiki/GPL_Tools#GPL_scripts_from_CHDK)
Sonic, thanks! I actually figured out the dump a few days ago, but could nopt figure out the dissasemble part, I have IDA but looking through that was no help because much of it was garble because I did not have and scripts, so now I should finally be able to dissasemble it to maybe help in finding the proper addresses. I understood what 1% wanted us to do back in that post but was just stuck since I could not search the firmware. Hopefully we find it so we don't need these tricks to get our Raw Rec going everytime we want to update to the latest source.

Oh, and to clarify, I know the script is not for IDA, I will look use it with ipython if I am correct?
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on May 31, 2013, 04:08:00 PM
Awesome work!

I am now able to get 960x512@24fps and 1280x400@24fps, using Hacked Mode with 720p@50 fps canon setting in video mode. Using a Sandisk 32GB 95Mb/s.
Title: Re: 550D raw video recording port official thread
Post by: sonic on May 31, 2013, 04:41:27 PM
I actually figured out the dump a few days ago, but could nopt figure out the dissasemble part, I have IDA but looking through that was no help because much of it was garble because I did not have and scripts

I tried the demo version, too (the free version doesn't do ARM). But I missed the map file for remake-elf (http://magiclantern.wikia.com/wiki/GPL_Tools/remake-elf) (the demo does only ELF).

Oh, and to clarify, I know the script is not for IDA, I will look use it with ipython if I am correct?

No, it's just a perl script using the gcc cross compiler tools.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 05:36:35 PM
running some tests now at the newest build.

my 550d got 2496*1065 at 4 fps without skipping....perfect for timelapsing:-))))
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 05:58:32 PM
pray for a 10bit mode or even better a compression like red does:-)
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 06:49:24 PM
So if I want to try to start shooting. Do I install the files from people's post just like the normal ml or is there another way?
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 06:55:07 PM
Ok, I will see if it will still work with those turned on, no problem! 8]
  Thank u man if I could pay u I would man. Your doing a lot of work I notice u and others. I haven't tested any of your builds, do I install it just like normal? Any info I haven't been up to date with ML
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on May 31, 2013, 07:13:40 PM
shawnwytch, you install the most recent/stable ML build (2.3), and what I've been doing is saving what is on my card to a folder on my computer. Then, you replace the autoexec.bin and the ML folder on the card with the ones that you see here on the forum.

In order to get the stable version back on, you obviously just do it in reverse. Place the autoexec.bin of the stable bin back on the card and replace the ML folder (it may ask you to merge, which is fine. what I have been doing lately is just deleting the ML folder and putting the test builds and stable builds on and off as I wish)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 07:14:25 PM
Awesome work!

I am now able to get 960x512@24fps and 1280x400@24fps, using Hacked Mode with 720p@50 fps canon setting in video mode. Using a Sandisk 32GB 95Mb/s.

Someone here stated that in 720p Canon mode, the raw video has some sprinkles on it... some little pixels appearing and disappearing: can you confirm this or not ? Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 07:22:11 PM
here an attempt of real 2500*1080 on my 550d

using panmode in 5*zoom.and merged 6 clips to 2500*1080 totally useless:-)

but when it will be possible to run 2 rawrecmodules simultainlesly on faster 5dm3 than it could be possible.

what would you think?

https://vimeo.com/67377902

what was your frame per sec on that looks good
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 07:26:30 PM
I kept on as many things as I could with the updated source with the flexinfo added, I wanted us to have the most recent updated source so I just made that one work for us, we will have the main features, at least the things I think we need with Raw Rec, if we want other features, those really have nothing to do with Raw Rec so best to use another Bin without Raw Rec.

If 960x480 does not work for you first try, dont give up, it usually works 2nd try and on.

Hacked mode does not seem to help.

Use Video mode, works best.

I notice wav recording does work in Raw Rec, it does create wavs fine even though we get a crash report, but this doesnt seem to be with Raw Rec, cause I see we get same error just trying to Record wav file in the Audio Menu without Raw Record on at all. I just kept recording with crash on screen, it still made new wav files, but probably best to not even use it, use a portable audio recorder like whats best for FPS feature.

The only Direct Draw feature that seemed to effect Raw Rec at 960x480 was focus peaking, but not always.

I see they still did not make a way to save Raw Rec settings like how other settings are saved.

http://www.mediafire.com/download/9agq38cf5mafb3c/ML_960x480_Raw_Rec.rar

On audio is it extracting it as a 2nd file or it it all into this raw file
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 07:28:14 PM
@dlrpgmsvc

forget the 720p mode:-) the imagequality is much worse then in 1080p mode

@shawnwytch

the framerate in this test was 23 fps but with a little trick and no usefull in praxis:-)
Title: Re: 550D raw video recording port official thread
Post by: fructose on May 31, 2013, 07:42:10 PM
Is anyone missing the RAW Video option from the most recent build?
Title: Re: 550D raw video recording port official thread
Post by: laconiccrusader on May 31, 2013, 07:46:10 PM
you need to load the module from the ML menu :)

i just recorded around 2800 frames of 1280*304 at 24 fps!
Title: Re: 550D raw video recording port official thread
Post by: fructose on May 31, 2013, 07:49:03 PM
you need to load the module from the ML menu :)

i just recorded around 2800 frames of 1280*304 at 24 fps!

This?

(http://cdn.gsmarena.com/pics/13/05/canon-5d-raw/gsmarena_001.jpg)

This I can no longer find.
Title: Re: 550D raw video recording port official thread
Post by: laconiccrusader on May 31, 2013, 07:55:36 PM
no, the last tab on the right you choose "load all modules" and "autoload on startup"
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 07:58:07 PM
Hi programmers !

I need a three hints to find three values in the ROM: they are marked as ? in the head post of this thread. So we can start the hunt together !

Many thanks to all for your efforts !  ;)
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 08:04:50 PM
I'm noticing the resolutions that people are stating mine isn't letting me change each individually like 1920/1080 or 640/480 can I change these values indavidually
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 08:10:03 PM
The best 24fps is 640/480
Title: Re: 550D raw video recording port official thread
Post by: fructose on May 31, 2013, 08:10:21 PM
no, the last tab on the right you choose "load all modules" and "autoload on startup"

Very strange, I don't have the M tab.

(http://i.imgur.com/sZKtViF.png)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 31, 2013, 08:31:06 PM
Ok, new build with Waveform turned back on and added back in better Rec Mod with more settings in it like before.

Still no luck with Raw playback on cam, still crashes till you take out battery so avoid using it.

http://www.mediafire.com/download/7gh9d57nazw9jkb/ML_Wave_BetterMod_Raw_Rec.zip
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 31, 2013, 08:32:14 PM
Very strange, I don't have the M tab.

(http://i.imgur.com/sZKtViF.png)
You are not using our special Raw rec build, those features in that menu are not enabled on it, plus no M, use the one I just posted link for.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 08:50:09 PM
thanks a lot mk11174!!!!!

i runs a the first test stable at 1280*400 at 23fps got 1 frame skipt after 4000 frames

thats fantastic so far!!!
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 08:59:50 PM
here another test....

550d 2496*1065 4fps

download the orginal file

https://vimeo.com/67414198
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on May 31, 2013, 09:31:05 PM
here another test....

550d 2496*1065 4fps

download the orginal file

https://vimeo.com/67414198
wow!! that looks amazing! so clean and crisp!
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 09:40:56 PM
@ mk 11147

not clean enough:-(my prores codec does not work its still down to shit h264.... >:(
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 09:42:22 PM
we need the 12 or 10 bit raw mode... when this happend maby in future then the rocket flys:-)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 10:10:21 PM
For example, 600D has the following values, and it seems that "allocmem" values are not needed at all (not present in 600D CONSTS.H file)... am I wrong ?!? Or do we need them for 550D ? :

#define HIJACK_CACHE_HACK_BSS_END_ADDR 0xFF0110D0
#define HIJACK_CACHE_HACK_BSS_END_INSTR  0xE3A01732
#define HIJACK_CACHE_HACK_INITTASK_ADDR 0xFF0110DC
Title: Re: 550D raw video recording port official thread
Post by: xaint on May 31, 2013, 10:24:07 PM
I think we need them, i found them here:

https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/src/ae7e5e2ec6a7d103fe1bfddb54329e5fc4a1225b/platform/600D.102/consts.h?at=default (https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/src/ae7e5e2ec6a7d103fe1bfddb54329e5fc4a1225b/platform/600D.102/consts.h?at=default)
Title: Re: 550D raw video recording port official thread
Post by: hammermina on May 31, 2013, 10:24:21 PM
any chance to trick up the sd slot controller?for more  write speed?
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on May 31, 2013, 10:54:13 PM
I got the video converted and wow so much control and clear I'm going crazy with joy. So is the raw doing something to make the image sharper
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 11:16:32 PM
Thanks xaint ! Happy to see you there !  8)

I'm keeping the info at header as updated and correct as possible, as I progress with my knowledge and integrating with the Others programmers knowledge, but many obscure points remains... for example: the comments say: "0xA0000 - 640k should be enough for everyone" (that's ok, 0xA0000 is the value equivalent to 640kbytes), but the next line relative to this comment is "#define HIJACK_CACHE_HACK_BSS_END_INSTR 0xE3A018C6" ...  :o  what is the connection of value 0xE3A018C6 with 0xA0000 ?!?  :o  Do this is the line that defines the quantity of reserved memory (640k) ? And how ?  :-[
Title: Re: 550D raw video recording port official thread
Post by: xaint on May 31, 2013, 11:27:02 PM
ok: good news: the cache hack is seems to be working, checking now...
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 11:29:44 PM
ok: good news: the cache hack is seems to be working, checking now...

Wow xaint ! I cannot believe !!! You are Always ahead ten miles ! Keep me informed about your checks results !  :o
Title: Re: 550D raw video recording port official thread
Post by: laconiccrusader on May 31, 2013, 11:37:12 PM
what does this cache hack can do?

i wanna thanks all the devellopers and for your awesome work!
 the 550D is now a top notch timelapse machine :D
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on May 31, 2013, 11:42:03 PM
what does this cache hack can do?

It allows to use the raw video feature without disabling other features, like now. So no more need to have two different sd cards (one for raw video and one for all the other ML features). Only one .bin file, only one version ! It allows to have more memory to fit all the ML stuff together with raw video recording option !
Title: Re: 550D raw video recording port official thread
Post by: sonic on May 31, 2013, 11:55:48 PM
ok: good news: the cache hack is seems to be working, checking now...

Just when I found out how to dump the ROM from the correct address 0xFF010000 X-)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 12:00:05 AM
Just when I found out how to dump the ROM from the correct address 0xFF010000 X-)

Good ! Keep on with the good work ! This will be of help for future needs of disassebly for future features and needs ! I added this info to the header post ! Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 12:13:58 AM
Ok, now where the hell can i find a magic.sym? :D :D

no matter, problem solved!
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 06:58:52 AM
hello guys

i have read that 550d can use sdxc cards is that right?an will this brings more speed.

" Die Serienbildgeschwindigkeit ist nominell von 3,4 auf 3,7 Bildern gesteigert bei reduzierter Serienbildfolge (6 RAWs bzw. 34 JPEGs gegenüber 9/170 einer 500D). In unserem Test ergaben sich im Schnitt 3,5 B/Sek. bei ebenfalls 6 RAWs in unverzögerter Folge. Gegenüber der 500D konnnte die Wartezeit zwischen zwei Bursts von 10 auf 7 Sekunden gedrückt werden, schnelle SD-Karten vorausgesetzt (mit 30MB/Sek.). Unterstützt werden jetzt auch SDXC-Karten ("eXtended Capacity") mit theoretischen 300 MB/Sek und 2 Terabyte Kapazität. Ersteres dürfte die Wartezeiten zwischen einzelnen Serienbildsalven an der 550D nochmal spürbar verkürzen, derzeit sind aber keine höheren Transferraten als 30MB/Sek. bei den SD-Karten verfügbar."

this is from review 2010

sdxc work on exFat.

what if i want to try to format a card to exfat?

will it work?
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 01, 2013, 08:43:47 AM
hello guys

i have read that 550d can use sdxc cards is that right?an will this brings more speed.

" Die Serienbildgeschwindigkeit ist nominell von 3,4 auf 3,7 Bildern gesteigert bei reduzierter Serienbildfolge (6 RAWs bzw. 34 JPEGs gegenüber 9/170 einer 500D). In unserem Test ergaben sich im Schnitt 3,5 B/Sek. bei ebenfalls 6 RAWs in unverzögerter Folge. Gegenüber der 500D konnnte die Wartezeit zwischen zwei Bursts von 10 auf 7 Sekunden gedrückt werden, schnelle SD-Karten vorausgesetzt (mit 30MB/Sek.). Unterstützt werden jetzt auch SDXC-Karten ("eXtended Capacity") mit theoretischen 300 MB/Sek und 2 Terabyte Kapazität. Ersteres dürfte die Wartezeiten zwischen einzelnen Serienbildsalven an der 550D nochmal spürbar verkürzen, derzeit sind aber keine höheren Transferraten als 30MB/Sek. bei den SD-Karten verfügbar."

this is from review 2010

sdxc work on exFat.

what if i want to try to format a card to exfat?

will it work?

SD card is not the bottleneck - it's card controller in our camera which limits the write speed.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 08:53:03 AM
yes i know...:-( but when the controller sees that is an exfat card it will go higher?

i formatet a card in exfat and shoot normal raw burst and i mean its write a littlebit faster as on fat32!

the normal Ml 2.3 runs in exfat on my 550d

but when i will install nightlybuild the comes an error on winrar
Title: Re: 550D raw video recording port official thread
Post by: Audionut on June 01, 2013, 08:54:59 AM
yes i know...:-( but when the controller sees that is an exfat card it will go higher?

The controller is limited to a certain speed regardless of how the card is formatted.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 09:04:29 AM
can we do something on the controller?replace or overclocking...

sorry for this stupid questions am totally a technicnoob:-)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 09:13:21 AM
sorry for this stupid questions am totally a technicnoob:-)

Just stop asking them.
Title: Re: 550D raw video recording port official thread
Post by: mohanohi on June 01, 2013, 10:02:36 AM
Great Suggestion alex  :)
Title: Re: 550D raw video recording port official thread
Post by: NedB on June 01, 2013, 10:30:39 AM
@mk11174: With your latest "ML_Wave_BetterMod_Raw Rec" build, I'm getting 1152x432 and also 1216x416 (both at 23.976fps) continuous, quite a step up from your/our previous best of 960x480! So 1280xsomething can't be far away and suddenly we're only uprezzing by 50% to get to 1080p rather than 100%. And all this in only a week or so, amazing.

Also noticing that with the new build I can really go up to (and over a little bit, I think) the 20MB/s mark on a continuous basis, whereas on the older builds, the limit seemed to be about 16MB/s. So there must be much better buffering and/or more memory available with your new build. Hope that doesn't merit a "duh".

My results above were in video mode, with hack on, no sound (obviously). Looking forward to more programming goodness in the coming days. Let me know if there are any tests I can/should do to help the effort. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: NedB on June 01, 2013, 10:40:35 AM
@mk11174: Oh, and one more thing. SanDisk ExtremePro 8GB 95MB/s, formatted with exFat and 16384KB cluster size. Have no idea if these details are relevant or useful...
Title: Re: 550D raw video recording port official thread
Post by: mohanohi on June 01, 2013, 10:52:18 AM
Now i am off to purchase SanDisk ExtremePro 8GB 95MB/s ...  :)
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 11:03:01 AM
at NedB how you get running exfat?

i tried it but only the officiel 2.3 build works on exfat .when i want to copy the nightlybuild i get an error:-(
Title: Re: 550D raw video recording port official thread
Post by: NedB on June 01, 2013, 11:28:30 AM
@hammermina: Format the card in Windows, you can choose exFat and also the cluster size ("Allocation Unit Size"). Then to make it bootable, run EOScard (google it). Next step is important: forget about the nightly build. Just use the link provided above in Reply #262 by MK11174. Unrar the contents and copy them as is to your SD card. This worked for me. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 01, 2013, 11:30:30 AM
exfat works fine with 550d, just format the card with eoscard utility, make it bootable, install stable ML through eoscard if you wish then substitute files and folders with MK11147 build.

**EDIT**

Posted sametime as NedB. :-)
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 11:31:13 AM
i tried it the same way but without clustersize...

i will try it in the afternoon:-)
Title: Re: 550D raw video recording port official thread
Post by: NedB on June 01, 2013, 11:39:31 AM
what he said...
Title: Re: 550D raw video recording port official thread
Post by: cinedude on June 01, 2013, 12:20:44 PM
By the way, if anyone is looking to buy SD cards...From what I've gathered, these Sandisk Extremepro cards are using something called UHS to enhance the read/write speed. The 550D isn't compatible with UHS, so it defaults to the maximum read/write speed of a regular class 10 card.

Something to think about if you're off to buy a really expensive card.

EDIT: I'm testing with a class 10 card, seems that the speeds are no where nearing what NedB got...
EDIT 2: Well now I'm running a benchmark test, and the card seems to actually be SLOWER than my class 6 one.  ???
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 01, 2013, 01:26:27 PM
spent a lot of time trying to find this topic. Looks like it has been moved without any notice. Good that I had my history

Here's another test http://www.youtube.com/watch?v=HRFjtxzRPLk

1344x448 (3:1) @ 18fps
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 02:25:28 PM
Just when I found out how to dump the ROM from the correct address 0xFF010000 X-)

Do you have found the disassembly start address of both ROM files ? And what they are ?
Do you have found what is the rom file where there is the stuff we are searching for ? ROM0.BIN or ROM1.BIN ?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 03:30:19 PM
I was able to get more memory going by adding the cach_hack code, but still believe we need 2 addresess from our firmware to make it work all the way.
By adding this code:
Code: [Select]
#define HIJACK_CACHE_HACK
#define HIJACK_CACHE_HACK_BSS_END_ADDR   0xFF01109C
#define HIJACK_CACHE_HACK_BSS_END_INSTR  0xFF010134
#define HIJACK_CACHE_HACK_INITTASK_ADDR  0xFF0110A8
#define ML_RESERVED_MEM (1024*1024 - BMP_VRAM_SIZE - 0x200) // see zebra.c, bvram_mirror_start initialization, and boot-hack.c

I think we just need these addresses to make it fit our firmware, if I am right?
#define HIJACK_CACHE_HACK_BSS_END_ADDR   0xFF01109C
#define HIJACK_CACHE_HACK_BSS_END_INSTR  0xFF010134

But whatever this does, it increases our memory in all places but our buffer mem of coarse, and I can enable a few more things but not much cause it still crashes.

Compare my screen cap to your cam and see.

(http://s18.postimg.org/qg5e3jl3d/VRAM0.png)

I still cant look through the firmware.

I tried the disassemble.pl but alls that did was give me more files I don't know what to do with.

I do have full version of IDA advanced 6.1 which I did use porting the a3300 but they had idc scripts that found names for all the addresses auto, I am not finding any idc scripts for IDA to work with 550D firmware, if I am wrong, someone please point me in the right place?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 03:43:37 PM
I think we just need these addresses to make it fit our firmware, if I am right?
#define HIJACK_CACHE_HACK_BSS_END_ADDR   0xFF01109C
#define HIJACK_CACHE_HACK_BSS_END_INSTR  0xFF010134

If you have Windows, follow my advice in the head post here (I keep it updated very frequently!!) , in order to disassemble directly from Windows !

Also, i found these instructions in our ROM1.BIN that "1%" user says are the start and end of allocation memory: i hope they are what we are searching for :

0xFF011CB4     E3A0160D     MOV R1,#0xD00000 (start address of allocation memory ?)
0xFF011CB8     E3A0083D     MOV R0,#0x3D0000 (end address of allocation memory ?)

So 1% says to subtract the value 0xA0000 (640k) to both 0xD00000 and 0x3D0000 values
0D00000 - A0000 = C60000

From tragic lantern for 600D we have :
---------------------------------------------------------------------------------
//MOV     R1, #0xD00000 C60000
// load ML in the AllocateMemory pool
#define HIJACK_CACHE_HACK_BSS_END_ADDR 0xFF0123E4
//0xA0000 - 640K Should Be enough for everyone
#define HIJACK_CACHE_HACK_BSS_END_INSTR 0xE3A018C6


 //~ MOV     R0, #0x3D0000 330000
//~ fixup start address of AllocateMemory pool 0x8F0000
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR 0xFF0123E8
//0x7D0000
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_INSTR 0xE3A00833
-----------------------------------------------------------------------------------

So, for us, we should have :
#define HIJACK_CACHE_HACK_BSS_END_ADDR 0xFF011CB4           <- Our address of the first instruction
#define HIJACK_CACHE_HACK_BSS_END_INSTR 0xE3A018C6   <- The machine code of new value (start value)
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR 0xFF011CB8  <- Our address of the second instruction
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_INSTR 0xE3A00833  <- The machine code of new value (end value)

The machine-codes of 600D and 550D are the same, because they have the same processors and so same instructions-sets and coding for them.

And don't forget this value also, specific for our 550D :

#define HIJACK_CACHE_HACK_INITTASK_ADDR             0xFF018D1C     
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 01, 2013, 03:51:12 PM
Do you have found the disassembly start address of both ROM files ? And what they are ?
Do you have found what is the rom file where there is the stuff we are searching for ? ROM0.BIN or ROM1.BIN ?

Neither of them, I think. I modified (https://bitbucket.org/hudson/magic-lantern/pull-request/103/550d-fix-debugdump_rom_task/diff) debug.dump_rom_task() to dump another ROM2.BIN
Then do
Code: [Select]
./disassemble.pl 0xFF000000 ROM1.BIN
But I didn't investigate further, since xaint has already solved it, hasn't he?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 04:11:21 PM


So, for us, we should have :
#define HIJACK_CACHE_HACK_BSS_END_ADDR 0xFF011CB4           <- Our address of the first instruction
#define HIJACK_CACHE_HACK_BSS_END_INSTR 0xE3A018C6   <- The machine code of new value (start value)
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR 0xFF011CB8  <- Our address of the second instruction
#define HIJACK_CACHE_HACK_ALLOCMEM_SIZE_INSTR 0xE3A00833  <- The machine code of new value (end value)
That leads to no boot with just red flashing light.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 04:14:00 PM
That leads to no boot with just red flashing light.

have you added also : #define HIJACK_CACHE_HACK_INITTASK_ADDR             0xFF018D1C       ?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 04:32:14 PM
have you added also : #define HIJACK_CACHE_HACK_INITTASK_ADDR             0xFF018D1C       ?
That boots cam but ML doesnt load at all.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 04:33:44 PM
That boots cam but ML doesnt load at all.

Ok, you have to go to the ML source directory PLATFORM/550d.109 and edit the file named "Makefile" : find the line "#RESTARTSTART = 0xC80100" and change the old pre-existent value to the new value (HIJACK_CACHE_HACK_BSS_END_INSTR + 100)

So we know that :
#define HIJACK_CACHE_HACK_BSS_END_INSTR 0xE3A018C6   
And hence :
0xE3A018C6 + 100 = 0xE3A019C6
And so, finally :
#RESTARTSTART = 0xE3A019C6  (into Makefile)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 04:43:39 PM
Why are you messing with this in the first place?!
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 04:45:03 PM
Why are you messing with this in the first place?!

? what is wrong ?  :o
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 01, 2013, 04:46:37 PM
That boots cam but ML doesnt load at all.

Im noticing that when u go up in resolution it records in a higher bitrate would telling the camera to record at a certin bitrate change how much buffer is needed? Just wondered if that would help any?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 04:57:28 PM
Why are you messing with this in the first place?!
lol, we have been trying to get more memory to make ML load all features with Raw rec so we don't have to disable features just to get it to load. Right now we are trying to figure out Hijack Cache
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 04:59:31 PM
Right now we are trying to figure out Hijack Cache

Have you done my last hint ? Do it works ?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:01:31 PM
Right now we are trying to figure out Hijack Cache

Also, very important   :

don't forget to replace ifdef 6D with
#ifdef HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR in boot-hack.c and get rid of allocate mem in internals.h
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 05:03:04 PM
Have you done my last hint ? Do it works ?
not yet, Alex scared me when he came in at that point.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:08:03 PM
not yet, Alex scared me when he came in at that point.

Don't worry, what I'm sayng to you are hints directly from 1% that replied to me in a private msg !  ;)

So, proceed with my last hint about makefile and take note about the #ifdef of my last post... we are so close !  8)
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 05:12:00 PM
Hi guys, you can find the cache_hack i've made, in my repo, if you wanna try:
I think it is here: https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc (https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc)
Try it on your own risk (for me it's pretty stable) :D:D


(http://xaint.hu/ML/cache_hack.jpg)

(I'm just now editing the test shots, what i've made)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 05:13:41 PM
Hi guys, you can find the cache_hack i've made, in my repo, if you wanna try:
I think it is here: https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc (https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc)
Try it on your own risk (for me it's pretty stable) :D:D

Ahh, there we go, cool, thanks man!

Update: Yep, 640k cool!! Thanks again xaint
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:25:16 PM
Hi guys, you can find the cache_hack i've made, in my repo, if you wanna try:
I think it is here: https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc (https://bitbucket.org/xaint/ml/commits/f3631da68349f1dda86ee136bbddc5a3c4efc9bc)
Try it on your own risk (for me it's pretty stable) :D:D

Whoa ! BINGOOO !!! Great work !!! Here we  are !!! Finally !!!  ;)   8)
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 05:25:24 PM
Ahh, there we go, cool, thanks man!

Update: Yep, 640k cool!! Thanks again xaint

If the changes what i've made are working, how can i push it to the main repo? Only the three affected files, without having to spoil something? :) Pull request?)
Thanks in advance ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:27:41 PM
If the changes what i've made are working, how can i push it to the main repo? Only the three affected files, without having to spoil something? :) Pull request?)
Thanks in advance ;)

hg commit
then PUSH to your repo (if you have made a repo online with bitbucket)
then make a pull request from your repo to Hudson repo (the official one)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:28:58 PM
If the changes what i've made are working, how can i push it to the main repo? Only the three affected files, without having to spoil something? :) Pull request?)
Thanks in advance ;)

Have you checked all the hints in the head post and the last I written to mk11174, so to be in phase with the mods ?  ;) They are 100% certified from... 1% !  ;D
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 05:33:40 PM
For all you guys that can't wait for the pull to be added!

Thank Xaint for the mem fix!

http://www.mediafire.com/download/145ctnwr5de524c/ML_Mem_All.zip
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 01, 2013, 05:36:29 PM
@xaint and @mk11174 : Very good work, boys !

Only one very important pray : do not erase your repos and modifications ! Don't think they are not useful because another programmer did it yet the same ! Keep all your work, because it may be useful to dig into the differences (if there are any) between your sources and the Others sources, in the case something wrong or bugs should arise in the next or long future !

Many thanks to all of you !!  ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 05:38:16 PM
@xaint and @mk11174 : Very good work, boys !

Only one very important pray : do not erase your repos and modifications ! Don't think they are not useful because another programmer did it yet the same ! Keep all your work, because it may be useful to dig into the differences (if there are any) between your sources and the Others sources, in the case something wrong or bugs should arise in the next or long future !

Many thanks to all of you !!  ;)
You too man! Without your posts things would have gone much much slower I am sure!
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 05:44:53 PM
Have you checked all the hints in the head post and the last I written to mk11174, so to be in phase with the mods ?  ;) They are 100% certified from... 1% !  ;D

Yes i've checked the hints in the head post, and i've used it really often, so thank you!

Also, very important   :

don't forget to replace ifdef 6D with
#ifdef HIJACK_CACHE_HACK_ALLOCMEM_SIZE_ADDR in boot-hack.c and get rid of allocate mem in internals.h

I'm not sure if this is needed!


You too man! Without your posts things would have gone much much slower I am sure!

And that's very true! So thanks again :)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 05:57:41 PM
I recommend keeping the classic boot method (I prefer to avoid cache hacks if possible); in theory, all you have to do is to adjust this:

Quote
    // change end limit to 0xc80000 => reserve 512K for ML
    // thanks to ARMada by g3gg0 for the black magic :)
    *addr_AllocMem_end = MOV_R1_0xC80000_INSTR; // <--- replace this with the new instruction (0xE3A00833), adjust RESTARTSTART, replace the 512's with 640 and that should do it
    ml_reserved_mem = 512 * 1024;

BTW, my plan is to keep ML slim and load things on demand, rather than just making it bigger and bigger.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 06:30:35 PM
I recommend keeping the classic boot method (I prefer to avoid cache hacks if possible); in theory, all you have to do is to adjust this:

BTW, my plan is to keep ML slim and load things on demand, rather than just making it bigger and bigger.

Oh a1ex, just in time with the simpler solution! :D

Loading things on demand is a good idea.

As i understand, you mean that almost every in-camera functions is just a module?  Like: RAW video feature will always be in the Movie menu, and when the user enabe it, then ML loads the raw_rec module in the background automatically. Right?
(Sorry for my english :| )

changing back to the classical mode btw..
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 06:36:52 PM
I recommend keeping the classic boot method (I prefer to avoid cache hacks if possible); in theory, all you have to do is to adjust this:
Interesting! I went back to original source with no cache hack and just adjusted the restart and it all loads and works fine, just 1 stupid address in one file all this time is all we needed, geeez 8[

note, available bin memory only say 512, not 640 with cache hack, but it still boots and loads everything.

where was our hero Alex all this time?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 06:49:00 PM
What I'm imagining is something like this: modules should be only a backend thingie (for better code organization and memory management), and they should be loaded on demand when you enable stuff in menu. When you no longer need say raw video, you disable raw video from menu, and the module gets unloaded automatically.

Also for backend functionality, not just for menus: say you want to record wav files - whenever you call WAV_Record, it loads the module if it's not already loaded, then records. After recording finishes, the module gets unloaded.

This will be required for TCC scripts. TCC engine is quite big, and now it's included in autoexec because it's used for module loading. We have to strip the compiler (which is big) and keep the elf loader part (small). Then, we'll load the compiler on demand whenever you would want to run a script.

If you never run scripts, the compiler will never get loaded and you have the resources free for whatever you are doing.

Also, for a stripped-down ML, you will just disable certain modules or delete them, and this will also declutter the menu.

Once we have a slim module loading engine (ppluciennik is working on it) and a working unload mechanism, we can enable these in main nightly builds.

In the long run: this will allow us to add big stuff to ML (think about OpenCV image processing or whatever) without worrying about memory being almost full. Also, modules are a bit like executables, so third parties will be able to add functionality without requiring us to include it in the official builds.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 01, 2013, 06:50:10 PM
tried exfat no speedimprovment on this...
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 01, 2013, 07:02:33 PM
speed improvement?? What's that? Greater than 24fps? :-)

exfat is about greater than 4GB files for ML anyways, also other features, although I maybe wrong. :-)
Title: Re: 550D raw video recording port official thread
Post by: V1t0 on June 01, 2013, 07:03:36 PM
One of 40 Frame shooted in RAW with  Magic Lantern in 550D at 1600x602 with a transcend SDHC 16GB class 10, to have a continuous video stream I had to use 960 x 360.
i need to find a faster SD to test the maximum continuos quality  :D
Just one crash when out of habit I used extended zoom to focus in RAW recording mode  ;)

(https://pbs.twimg.com/media/BLr3vCcCIAA06ma.jpg:large)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 07:08:23 PM
Not sure if it just me, but I am having best luck with this version of just changing the restartstart address and not using cache_hack, everything is from updated main repo source except raw_rec module and the address in the makefile for restartstart.

http://www.mediafire.com/download/plw6zywq4zr5wq4/ML_Mem_All_Fix.zip

960x480 seems to record without skip 1st try everytime.

When I use cache hack version, it skips first try.
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 07:10:25 PM
You must update *addr_AllocMem_end and ml_reserved_mem; otherwise, Canon code will overwrite ML sooner or later and you'll wonder what's going on.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 07:19:40 PM
You must update *addr_AllocMem_end and ml_reserved_mem; otherwise, Canon code will overwrite ML sooner or later and you'll wonder what's going on.

Ok, i did it, i updated  *addr_AllocMem_end and ml_reserved_mem, but it shows ~2500 K free mem for AllocateMemory.

I think this is not good :)

(http://xaint.hu/ML/VRAM1.jpg)

What should I do?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 07:37:01 PM
Code: [Select]
// mov r1, #13631488  ; 0xd00000  <-- end address
// mov r0, #3997696   ; 0x3d0000  <-- start address
// hex(0xd00000 - 640*1024) => new end address is 0xc60000

#define MOV_R1_0xC60000_INSTR 0xE3A018C6 // mov r1, 0xc60000

// change end limit to 0xc60000 => reserve 640K for ML
*addr_AllocMem_end = MOV_R1_0xC60000_INSTR;
ml_reserved_mem = 640 * 1024;

RESTARTSTART    = 0xC60100

Works for me, all checks OK.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 07:57:38 PM
Code: [Select]
// mov r1, #13631488  ; 0xd00000  <-- end address
// mov r0, #3997696   ; 0x3d0000  <-- start address
// hex(0xd00000 - 640*1024) => new end address is 0xc60000

#define MOV_R1_0xC60000_INSTR 0xE3A018C6 // mov r1, 0xc60000

// change end limit to 0xc60000 => reserve 640K for ML
*addr_AllocMem_end = MOV_R1_0xC60000_INSTR;
ml_reserved_mem = 640 * 1024;

RESTARTSTART    = 0xC60100

Works for me, all checks OK.
Gotcha, thanks
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 08:09:59 PM
After Alex's final note, here is the updated version that gives us 640K

http://www.mediafire.com/download/bmxuj7uobt7fudi/ML_Mem_All_Fix2.zip
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 08:25:07 PM
Memory map (first 512MB):

(http://a1ex.magiclantern.fm/bleeding-edge/raw/memmap550D.png)

If we find out how to recover the blue segments, it should work a lot better. Right now it's only using the green ones.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 01, 2013, 08:45:04 PM
Guess I did it right, mine matches yours  :D

(http://s23.postimg.org/w1fwjpc63/VRAM0.png)

Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 01, 2013, 09:30:07 PM
With this latest build, not noticed it before, maybe it was there but resolution and aspect ratio don't seem to work correctly, if you set resolution and then aspect ratio, resolution changes but it doesn't change to suit dialed in aspect ratio but instead gives in brackets (almost whatever:1) which is different to aspect ratio chosen.??

So default is 1024x576 aspect ratio 16:9 both aspect ratio chosen and AR in brackets match, but then change AR to 2.39:1 in the raw menu, resolution changes to 1024x432 and in brackets 1024x432 (2.37:1), change AR in menu to 2.35:1, resolution changes to 1024x448 in brackets below 1024x448 (almost 2.29:1)

Confused.
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 09:39:45 PM
You can only choose resolutions multiple of 64x32 or 128x16, for speed reasons. See http://www.magiclantern.fm/forum/index.php?topic=5839.msg42968#msg42968

I can remove this restriction and keep the write speeds, but this requires changing the file format and the converter.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 01, 2013, 10:00:28 PM
Quick test shot (1200x400 23.976)
SanDisk Extreme Pro 16GB 95Mb/s

Title: Re: 550D raw video recording port official thread
Post by: 1% on June 01, 2013, 10:02:12 PM
Don't. The restriction is good, write speeds have improved.  I have a card writing 32MB now.

Good that copy and restart method can use 640K too...

For cache hacks you needed to patch boot-hack.c to patch the start also. When properly done allocate mem goes down in the memory menu (600D/EOSM/6D). 6D had broken wifi/tethering till this was discovered
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 01, 2013, 10:29:49 PM
Quote
Don't. The restriction is good, write speeds have improved.  I have a card writing 32MB now.

I mean, remove the multiple restriction, but keep the improved write speed. You gain smaller frame sizes, no wasted pixels. For this I need to add some padding for each FIO_WriteFile to round it to 512K, but the converter must know about this somehow, so it will be done on next major file format change.
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 01, 2013, 10:50:14 PM
Heh, you just made me thing of something... probably no point in patching start address if there is no dword or subtraction.. 'doh. Have to investigate this as I have some initial record issues on 600D. Either way I'm subtracting right now from the start address, shouldn't be.

Yup... hahah it was wrong, only need to modify it if its sub r0, r1, total.. not patch start address to start earlier.... the more you know. Wheaties for breakfast  :-[
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 02, 2013, 12:57:37 AM
You can only choose resolutions multiple of 64x32 or 128x16, for speed reasons. See http://www.magiclantern.fm/forum/index.php?topic=5839.msg42968#msg42968

I can remove this restriction and keep the write speeds, but this requires changing the file format and the converter.

Thanks, I thought there must be a technical reason, hadn't considered it was a mod16 thing, even though well aware of it and that the 550D is 1920x1088.  :-[
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 02, 2013, 01:10:39 AM
Quick test shot (1200x400 23.976)
SanDisk Extreme Pro 16GB 95Mb/s

xaint, looks good but was that shot in Photo mode? The metadata for the .mp4 says 1920x640 at 30fps? mediainfo and VLC concurr.

Regarding photo mode, I seem to get more resolution, without failing, but guess something else is going on. I have fps override on at 24.000 exact and manual lens.
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 02, 2013, 03:05:52 AM
Great work with all new improvements
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 02, 2013, 09:16:35 AM
Just wanted to support all the developers on this 550D port. Not everyone is capable of buying RED camera or 5DMk3, the possibility to record in such quality on our 550d is real inspiration. Thank you all!
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 02, 2013, 10:19:12 AM
xaint, looks good but was that shot in Photo mode? The metadata for the .mp4 says 1920x640 at 30fps? mediainfo and VLC concurr.

Regarding photo mode, I seem to get more resolution, without failing, but guess something else is going on. I have fps override on at 24.000 exact and manual lens.

Nope, i think it was in movie mode (1920 24fps), fps override on at 24.000. I think it is just wrong comp settings in After Effects. I hurried..
(so actually you see the things a little bit faster than it was :D)
Title: Re: 550D raw video recording port official thread
Post by: bzhwindtalker on June 02, 2013, 02:25:15 PM
Hey guys, here's my test, recorded at 1024*382 (max stable for me) Seems to be a lot of dropped (0KB) frames, it's not a bad tripod issue^^
EDIT : cant' find how to embeed vimeo, so I reuploaded to YT.
Raw2Dng > Ligthroom > Premiere
Browsing througth the footage took ages with my laptop!
https://vimeo.com/67499166 (https://vimeo.com/67499166)
Title: Re: 550D raw video recording port official thread
Post by: JohnBarlow on June 02, 2013, 03:52:12 PM
Can we have a feature to input custom aspect ratio and frame size via an editable data file?

It seems to me this would remove the need to beg for custom settings to be hard coded, which is a practice that has not worked for me ever, so far :)

Thanks
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 02, 2013, 05:51:32 PM
That's why I needed a low-level formatting:  :-\

(http://xaint.hu/ML/llf.png)
Title: Re: 550D raw video recording port official thread
Post by: dpiximaj on June 02, 2013, 10:00:06 PM
16fps @ 1280x640 RAW  https://vimeo.com/67514522  Thanks to mk11174!  Really quite amazing!
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 02, 2013, 10:10:12 PM
iam shooting a short testfilm at 1280*544 at 18fps in 1080p mode....the images are amazing!!!

i recomend not to upscaling from 960 that ruined the wonderfull image...go down in framerates:-)

i put all my hope in a stable 1280*544 on 24fps maby a 10bit mode can fix that.

Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 02, 2013, 11:05:04 PM
16fps @ 1280x640 RAW  https://vimeo.com/67514522  Thanks to mk11174!  Really quite amazing!
Beautiful shots! Shot one more, preferebly from the tripod.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 03, 2013, 01:20:56 AM
Thanks for all the comments and credit guys, but really Alex and the Devs deserve 100% of the credit for coming up with the idea and building this awsome module, I just helped get it to us faster. Thanks again! Hope you are having as much fun as me playing with a new module, it always makes you feel like you have a new camera everytime you get to play with a new feature from ML.  :D
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 03, 2013, 02:23:01 AM
Do u think it looks more like we won't see 1080 at 24fps I may just sell this. And upgrade I've been holding off. Raw made me freeze
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 03, 2013, 02:28:24 AM
You definitely are getting a lot of the credit mk11174, especially over on YouTube (I've seen your name mentioned a couple times - including on my video). But regardless of what part you play in the process, we all appreciate you putting them together for an easy download for us!!

I really thought we would be limited by the buffer/write speed of the 550D but it's amazing what the devs have been able to juggle to get the camera to write to the card so efficiently!

Anyway, I'll back away from posting now so that the devs can converse about what additional memory allocation we can squeeze out of these!
Title: Re: 550D raw video recording port official thread
Post by: V1t0 on June 03, 2013, 02:40:28 AM
A funny test on a slow Sandisk Extreme class10 SDHC 30MB/s (in reality 18-20MB/s write)
So the max size in continuos recording was 832x480 at 24p, i know, it is small resolution and it is a stupid test, but it was incredible the amount of information in grading  :o
I need to try with a faster SD to see higher resolutions!


https://vimeo.com/67526475
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 03, 2013, 03:38:56 AM
Do u think it looks more like we won't see 1080 at 24fps I may just sell this. And upgrade I've been holding off. Raw made me freeze
Being that it is because of the sd controller card being the limiting part, I don't think we will ever get 24p at 1080 it is just a hardware limitation we can't overcome.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 03, 2013, 04:06:24 AM
Being that it is because of the sd controller card being the limiting part, I don't think we will ever get 24p at 1080 it is just a hardware limitation we can't overcome.

How much more success do we anticipate? Do we believe we can get the shoot_malloc total any larger than it is, or is that exactly what the devs are investigating? (please don't misinterpret what I mean. I am not impatient. I am just making sure that we are all being realistic about how far we can push these devices before it doesn't have an impact) Do we believe that a lower bit rate will add any significant increase to write speed or is that like apples and oranges?

Also, I still see mention of people looking for faster cards, but am I correct in assuming that unlike the Mark 3, we are limited anyway because of the sd controller, so just that we are all on the same page, my 35MBps card should be sufficient then, correct? PS I mentioned in my last post that I would try to not post to free the forum up of clutter....I apologize :)
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 03, 2013, 07:54:14 AM
Well, according to this bitrate calculator and considering the 22mbps buffer limit, we should be able to get stable 1280*544 24p. (Assuming we can use 10bit) That allows to export 2.35:1 720P video without any upscaling or frame interpolation (with black bars). That's bloody amazing, especially considering that the original purpose of Magic Lantern was to skip the audio auto-levels on the MarkII!

http://web.forret.com/tools/video_fps.asp?width=1280&height=544&fps=24&space=raw&depth=10

Crop mode is also a huge milestone. I'm not sure if it can be sent back to H264 video, to use it when Raw is not necessary.

Also, does somebody know if low res Raw will be able to get the full sensor by skipping lines? I mean, keep the vision angle regardless of the resolution.

Cheers!
Title: Re: 550D raw video recording port official thread
Post by: otherman on June 03, 2013, 10:17:48 AM
what about send video data to USB, instead of SD card? Is it possibile?
I'm thinking of an app (on PC or on android tablet) recording the raw video; our DSLRs send liveview on USB, than it is theoricaly possible in some way.

(Sorry forma my english, it's not my language)

Thanks all the Devs for this amazing work!
Title: Re: 550D raw video recording port official thread
Post by: cbmk on June 03, 2013, 10:43:48 AM
what about send video data to USB, instead of SD card? Is it possibile?
I'm thinking of an app (on PC or on android tablet) recording the raw video; our DSLRs send liveview on USB, than it is theoricaly possible in some way.

(Sorry forma my english, it's not my language)

Thanks all the Devs for this amazing work!

No, the mini-USB 2.0 is actually slower than the SD controller, so just trying would be pointless. What could be interesting, however, is to try (if possible) making the HDMI clean 10 bit 1080p 16:9, and record externally to something like 10 bit Prores. It definitely would not be raw, but still miles better than the in-camera H.264.
Title: Re: 550D raw video recording port official thread
Post by: mrwolf on June 03, 2013, 11:38:53 AM
Well, according to this bitrate calculator and considering the 22mbps buffer limit, we should be able to get stable 1280*544 24p. (Assuming we can use 10bit) That allows to export 2.35:1 720P video without any upscaling or frame interpolation (with black bars). That's bloody amazing, especially considering that the original purpose of Magic Lantern was to skip the audio auto-levels on the MarkII!

http://web.forret.com/tools/video_fps.asp?width=1280&height=544&fps=24&space=raw&depth=10


Nice tool, so if the limit is 22MB/s and we if we could adjust the size per px would these be the maximum resolutions the 550d could theoretically do @ 24p?

Ratio  Horizontal px  Vertical px  Bit Rate (MB/s)
1.3398774221.97
1.66110266421.95
1.77113864321.95
1.85116462921.96
2.4132655322

Its pretty crazy what the ML team have been able to do thanks to all the devs for making this happen!

edit: Ignore my witterings I see the somone else mentioned the limit is 21.3MB/s.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 03, 2013, 12:05:30 PM
@xaint and @mk11174 : do one of you already made a pull request about the new and last (and only one...  ::) ) modification ?   ;)
Do the old hack mods pull requests where already deleted or reversed ?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 03, 2013, 05:09:17 PM
@xaint and @mk11174 : do one of you already made a pull request about the new and last (and only one...  ::) ) modification ?   ;)
Do the old hack mods pull requests where already deleted or reversed ?
One of the other guys did it but it is all updated, the module everyone likes is from tragic-lantern though, not the unified, that is the only thing that can't change. But the one from the unified seems to be working nicely, there adding things to it but we can't use the features cause of no Stubs yet for 550D, nothing to increase our speed or anything, something with the playback.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 03, 2013, 05:53:54 PM
One more sample from today 1408x480 @18fps

https://vimeo.com/67575591

So.. several bugs to report.
1) Deleting raw files does not work properly and I can't switch from one raw file to another for in camera playback
2) 10x zoom kills camera, so would be nice to have it disabled by default.
3) Something weird going on with aperture and shutter settings. I can't get the logic here, but they seem to be changing when I switch to 5x. Also exposure visually seems to be different after camera restart, though the aperture and shutter settings remain the same. Why are they shown in red btw? Shutter setting seems to have almost no effect, when I change it from 200 to anything up to 4000, only aperture affects the amount of light..Maybe I am missing something?
4) When I extract dng's they seem to be at a smaller resolution compared to settings in camera, why is it so? For example for 1408x480 video dng's are 1392×464.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 03, 2013, 07:00:03 PM
One more sample from today 1408x480 @18fps

http://youtu.be/bleWVuDiqtE

So.. several bugs to report.
1) Deleting raw files does not work properly and I can't switch from one raw file to another for in camera playback
2) 10x zoom kills camera, so would be nice to have it disabled by default.
3) Something weird going on with aperture and shutter settings. I can't get the logic here, but they seem to be changing when I switch to 5x. Also exposure visually seems to be different after camera restart, though the aperture and shutter settings remain the same. Why are they shown in red btw? Shutter setting seems to have almost no effect, when I change it from 200 to anything up to 4000, only aperture affects the amount of light..Maybe I am missing something?
4) When I extract dng's they seem to be at a smaller resolution compared to settings in camera, why is it so? For example for 1408x480 video dng's are 1392×464.

3) FPS override maybe?
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 03, 2013, 07:14:31 PM
@xaint, yes, fps override is constantly on at 18fps, so I am not changing it..
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 03, 2013, 08:25:57 PM
Try the constant exposure option - it will not extend the shutter speed range, but will adjust ISO to compensate for that.
Title: Re: 550D raw video recording port official thread
Post by: Pharinen on June 03, 2013, 08:31:25 PM
...
2) 10x zoom kills camera, so would be nice to have it disabled by default.
...
Yeah, I have noticed the same.
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 03, 2013, 08:52:22 PM
I started shooting raw yesterday on my t2i. Wow it's a new camera!

I'm a raw shootist for life. No going back.

I am only getting 70 frames at a time at 960-544, but still it's shockingly better then 1920-1080 smashed by h.264.

Thanks so much for everyone's hard work to make this happen.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 03, 2013, 10:58:03 PM
Here are 2 builds with the new Filemanager there working on. I added the Stub for SeekFile to get it going.

This is the build with Tragic-Lanterns more res option Raw Rec module:
http://www.mediafire.com/download/96zgrdjaubamjuh/ML_Fileman_Raw_Tragic.zip

This is the Magic-Lantern build with the regular Raw Rec module:
http://www.mediafire.com/download/411wvydehbwfxcw/ML_Fileman_Raw_Unified.zip


Anyone wondering the differ between the 2 builds, they are both from the Unified branch, the only differ is, the tragic one uses the Rec module from Tragic-Lantern, it just has differ options that most of you seem to enjoy, even new options now from the last build. And the Magic build has the Raw_Rec module that is with the Unified build, less options but for me seems more stable, but did not do alot of testing so don't quote me on it, both are cool though.

The main thing is, both have the new file manager that can be used to view all the raw videos you made, not just 1 like in the module menu.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 04, 2013, 12:25:34 AM
Here are 2 builds with the new Filemanager there working on. I added the Stub for SeekFile to get it going.

This is the build with Tragic-Lanterns more res option Raw Rec module:
http://www.mediafire.com/download/96zgrdjaubamjuh/ML_Fileman_Raw_Tragic.zip

This is the Magic-Lantern build with the regular Raw Rec module:
http://www.mediafire.com/download/411wvydehbwfxcw/ML_Fileman_Raw_Unified.zip

I'm still getting better results with the "fix2" build. Attempted similar/same resolutions and with the "fix2" build - it will indicate to me that I have continuous recording, and although I didn't write down the results, I attempted to keep the resolution around 1280 at an aspect ratio of 3:1 and it only worked with that build. I cannot recreate that success with these. Unsure if this helps, but I thought I'd mention it.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 12:33:21 AM
I'm still getting better results with the "fix2" build. Attempted similar/same resolutions and with the "fix2" build - it will indicate to me that I have continuous recording, and although I didn't write down the results, I attempted to keep the resolution around 1280 at an aspect ratio of 3:1 and it only worked with that build. I cannot recreate that success with these. Unsure if this helps, but I thought I'd mention it.
Not much different other then the addition of file manger as far as I know, so not sure why there would be a differ in record ability, but I guess it is possible more stuff is not always better.

Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 04, 2013, 12:49:40 AM
yea, I'm unsure what it is. Possible side effect? I just found it odd that when I went to replicate what I did on the other build, I couldn't with these.

But again, just throwing it out there as informational.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 12:52:20 AM
yea, I'm unsure what it is. Possible side effect? I just found it odd that when I went to replicate what I did on the other build, I couldn't with these.

But again, just throwing it out there as informational.
I am only able to use that 1280x 3:1 aspect at 21fps stable with no skips with this build, I will try Fix2 just to see what happens, you have me curious.  :D

Update: well still no 24fps but I am able to get 22fps with those settings with Fix2 so must be a bit better, but the only addition is Fileman so I can try this new build without fileman and see what happens.

Update2: No, fileman does not make a differ, results are totally random at 22fps for me sometimes it never stops till I stop it, sometimes I only get 66frames.

21fps works perfect either way at that res.

Tragic lantern version has a cool greyscale preview option while recording raw, it shows exactly what your recording, much nicer to see what is being cropped.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 04, 2013, 01:13:39 AM
sounds awesome.

Yeah, I apologize. I wasn't at 24fps either. I forgot to include that information. I only noticed it because I literally tried to use the same settings and that is when I thought "wait a sec....".   :D
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 04, 2013, 01:18:44 AM
I added the Stub for SeekFile to get it going.

Is this available on bitbucket?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 01:22:05 AM
Is this available on bitbucket?
No, not yet, I dont know how to add to that, I just added it to build it myself for now till someone that knows how adds it.

If you try to build now from bitbucket and use Raw it will not work because of the Seek address not there yet.

line: 85
NSTUB( 0xFF1C691C, FIO_SeekFile)

If you know how to get it on there or pull it or whatever its called, lol
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 04, 2013, 01:33:51 AM
Update2: No, fileman does not make a differ, results are totally random at 22fps for me sometimes it never stops till I stop it, sometimes I only get 66frames.

Yes, I just noticed that now, after testing it again, I'm getting different results also. Last night I had some 30 second footage at 1280 at 3:1 at 18fps (override) - and the files on my computer that I just checked to verify - and now I cannot even duplicate that, even with the fix2 build.

Very interesting.
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 04, 2013, 01:35:31 AM
If you know how to get it on there or pull it or whatever its called, lol

It's actually quite simple and fun (as long as the VCS doesn't start fighting with you ;) ):

Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 02:20:39 AM
It's actually quite simple and fun (as long as the VCS doesn't start fighting with you ;) ):

  • Fork (https://bitbucket.org/hudson/magic-lantern/fork)
  • hg clone https://bitbucket.org/mk11174/magic-lantern
  • Make your changes
  • hg commit path/file.c
  • Enter commit message
  • hg push
  • Press Pull request on bitbucket website
  • Voilà :) (https://bitbucket.org/hudson/magic-lantern/pull-request/106/550d-fio_seekfile-from-mk11174/diff)
Cool, thanks for the info, maybe I will try it next time I need to add something. Thanks!

Now we need to try to get more Buffer Memory like the other cams, even the 500D has 95, I just tried Raw on my 500D and I get high res then on 550D with no skip.

By the way 1280x400x24fps just fine on 500D
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 04, 2013, 02:24:48 AM
Now we need to try to get more Buffer Memory like the other cams, even the 500D has 95, I just tried Raw on my 500D and I get high res then on 550D with no skip.

I already tried to find sourcecode for the sRAW experiments from the past (https://groups.google.com/forum/?fromgroups#!msg/ml-devel/AyPANkaXbp0/PMwkzwuVy14J), but couldn't find anything yet. I'm also afraid of the permanent Err70 this seems to provoke (http://www.magiclantern.fm/forum/index.php?topic=1746.msg6039#msg6039).
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 02:27:38 AM
Ah really, permanant error 70, interesting, that is scary
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 04, 2013, 02:39:08 AM
Ah really, permanant error 70, interesting, that is scary

I just thought "what the heck" and tried
Code: [Select]
        if (should_run_polling_action(20000, &aux))
        {
set_pic_quality(PICQ_SRAW);
            guess_mem_running = 1;
            guess_free_mem();
set_pic_quality(PICQ_RAW);
        }
in debug.c
but still only 75 MB.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 02:51:54 AM
I just thought "what the heck" and tried
Code: [Select]
        if (should_run_polling_action(20000, &aux))
        {
set_pic_quality(PICQ_SRAW);
            guess_mem_running = 1;
            guess_free_mem();
set_pic_quality(PICQ_RAW);
        }
in debug.c
but still only 75 MB.
I already enabled it a couple weeks ago but never knew about the err70 thing, lol, it seems when I did load it, I just got a red rectangle across the screen with some address in it, but like you, mem was still 68 back when I tried it.
Title: Re: 550D raw video recording port official thread
Post by: Greg on June 04, 2013, 03:10:27 AM
NSTUB( 0xFF1C691C, FIO_SeekFile)

I need this to 500D how to find it?
Here it is, but I do not know how to do it - https://bitbucket.org/hudson/magic-lantern/commits/01e1e1c267d3396d6ddf6738a815754e28b9367d
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 03:30:42 AM
I need this to 500D how to find it?
Here it is, but I do not know how to do it - https://bitbucket.org/hudson/magic-lantern/commits/01e1e1c267d3396d6ddf6738a815754e28b9367d
NSTUB( 0xFF1968B4, FIO_SeekFile) is for 500D
Title: Re: 550D raw video recording port official thread
Post by: Greg on June 04, 2013, 03:44:56 AM
NSTUB( 0xFF1968B4, FIO_SeekFile) is for 500D
ok, thank you  ;)
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 04, 2013, 04:03:32 AM
0 props need to be blocked out or it won't change, just give you the red square. Then you need to change mode to apply it. Hard writing the 0 props seems to change it right away but then you have these err 70 problems. EOSM just shut down when put into sraw.
Title: Re: 550D raw video recording port official thread
Post by: sonic on June 04, 2013, 04:21:17 AM
0 props need to be blocked out or it won't change, just give you the red square. Then you need to change mode to apply it.

I commented out
Code: [Select]
        if (should_run_polling_action(20000, &aux))
        {
set_pic_quality(PICQ_SRAW);
            guess_mem_running = 1;
            guess_free_mem();
//set_pic_quality(PICQ_RAW);
        }

void set_pic_quality(int q)
{
    if (q == -1) return;
    prop_request_change(PROP_PIC_QUALITY, &q, 4);
//    prop_request_change(PROP_PIC_QUALITY2, &q, 4);
//    prop_request_change(PROP_PIC_QUALITY3, &q, 4);
}

and switched between Movie/Night Portrait and P/LV, but always 75 MB.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 04, 2013, 10:38:34 AM
No, not yet, I dont know how to add to that, I just added it to build it myself for now till someone that knows how adds it.

If you try to build now from bitbucket and use Raw it will not work because of the Seek address not there yet.

line: 85
NSTUB( 0xFF1C691C, FIO_SeekFile)

If you know how to get it on there or pull it or whatever its called, lol

I dunno who made this, but your modification is already merged in the bitbucket unified ! Great !

I have, however, some questions, just to clarify things better, to me and to others that may come to help :

[1] Do there are Others stubs to search for (not for this specific memory problem, but for other purposes... just to know) ?

[2] Do someone knows what are the source files (and where are they located) that are involved into enabling sRAW feature and at what lines, inside them ?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 01:51:12 PM
I dunno who made this, but your modification is already merged in the bitbucket unified ! Great !

Sonic took care of it  :D
Title: Re: 550D raw video recording port official thread
Post by: GregoryOfManhattan on June 04, 2013, 01:58:31 PM
@Sonic, did you need a dump to get the correct FIO_SeekFile?
we need to get this for the 50D also.

what was the symptom of an incorrect RESTARTSTART - i see a1ex commit to reboot-all.c for 550D

Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 02:21:16 PM
@Sonic, did you need a dump to get the correct FIO_SeekFile?
we need to get this for the 50D also.

try for 50D NSTUB( 0xff9829b0, FIO_SeekFile)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 04, 2013, 02:43:52 PM
So what are you saying guys - raw is now enabled in unified builds for 550d?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 03:04:08 PM
So what are you saying guys - raw is now enabled in unified builds for 550d?
No, you have to build yourself to get the M menu to load modules, if you cant build just use my latest build, it is up to date with bitbuckit.

But everything is added to 550D port now to make raw load and work, just need to build yourself to enable modules.

Only thing we need to catch up with the other cams is a bit more shoot_malloc memory, 1% got us from 68mb to 75mb, now we just need to get to 95mb like the 500D then it will help us get a bit higher res at 24p. The 500D is getting 1280x400x24fps
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 04, 2013, 03:08:58 PM
Let me know what are you tinking about this possible discovery of mine : There are clues that, in order to make room for the raw_video_rec module, we used the shoot_malloc memory to put there the ML code, so shrinking it, so we cannot have more shoot_malloc memory anymore... look at this : http://www.magiclantern.fm/forum/index.php?topic=5071.0
Title: Re: 550D raw video recording port official thread
Post by: sharpshooter on June 04, 2013, 07:08:13 PM
Hey, I'd like to congratulate the ML developers for another revolution on the DSLR history.
I've been testing this on my 550D and I'm loving it, but I noticed in the build that I'm testingthat only resolutions up to 1728x672 are avaliable, why is that ? Is it a temporary problem or another limitation of the camera ? Because with low framerates one could get more that that... So, technically, could we get it up to 4K, or at least 2K ?
Title: Re: 550D raw video recording port official thread
Post by: Alex546 on June 04, 2013, 07:17:57 PM
Could it be possible to record your RAW movies with a higher resolution but monochrom? Maybe 2k or 4k on a 550d.


550d, 1280x425(streched) @24 fps:

Title: Re: 550D raw video recording port official thread
Post by: 1% on June 04, 2013, 07:20:33 PM
Not likely.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 07:46:31 PM
Hey, I'd like to congratulate the ML developers for another revolution on the DSLR history.
I've been testing this on my 550D and I'm loving it, but I noticed in the build that I'm testingthat only resolutions up to 1728x672 are avaliable, why is that ? Is it a temporary problem or another limitation of the camera ? Because with low framerates one could get more that that... So, technically, could we get it up to 4K, or at least 2K ?
You can get higher res in 5x mode, go into 5x mode first then turn on raw. You might want to go into zoom setting in ML and disable 10x mode so you don't accidentally crash the camera while in raw and switching to 10x mode. I don't think it is anything wrong with the max res we get, it is just the max size our camera can do.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 04, 2013, 08:34:28 PM
lack of time pushed me to sell one of my t2i' now I'm considering switching to EOS M, faster cpu, faster card-io chip, maybe a better luck. but I'm still keeping my old t2i.
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 04, 2013, 10:24:42 PM
so if u go into 5x before turning on raw this helps the camera? im confused im on a 45mbit card and im not able to go to anywhere close to the posted resolutions that have been stated here. also i heard someone saying that its possible to view your raw files on camera is this possible
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 10:41:22 PM
so if u go into 5x before turning on raw this helps the camera? im confused im on a 45mbit card and im not able to go to anywhere close to the posted resolutions that have been stated here. also i heard someone saying that its possible to view your raw files on camera is this possible
Yes, with the new build I just posted yesterday, you can use the new filemanager to view the raw clips, or if you get the tragic lantern build i posted on the same post you can view your raw clips in the raw video menu too.

The filemanager is in the debug menu at the top.

And going to 5x mode does not help, but it does record higher res, you will not get 24fps, all rules of write speed still apply, I use the higher res for timelapse at 4fps

Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 04, 2013, 11:38:30 PM
@mk11174: the mod 1% did, after which we on 550D obtained more shoot_malloc memory, I think is that: https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/a926b83dc3e933e42341baa3bd145ffd2aff7e81
So can we try to lower the new value, say put 0xc70100 instead of the preexistent 0xc60100, just to lower the autoexec.bin memory and so (hopefully) increase the shoot_malloc memory pool ?  ???
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 04, 2013, 11:50:28 PM
Does Lowering The Qscale l to 0.50 use less memory? so it records at a lower bitrate
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 04, 2013, 11:57:15 PM
Does Lowering The Qscale l to 0.50 use less memory? so it records at a lower bitrate
If you mean for Raw, no Qscale has nothing to do with Raw.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 05, 2013, 12:00:23 AM
@mk11174: the mod 1% did, after which we on 550D obtained more shoot_malloc memory, I think is that: https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/a926b83dc3e933e42341baa3bd145ffd2aff7e81
So can we try to lower the new value, say put 0xc70100 instead of the preexistent 0xc60100, just to lower the autoexec.bin memory and so (hopefully) increase the shoot_malloc memory pool ?  ???
This is where he got more memory.
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/60b04d7254cf8c5add9ee4a96822a1a7c81e1503
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 05, 2013, 12:07:58 AM
This is where he got more memory.
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/commits/60b04d7254cf8c5add9ee4a96822a1a7c81e1503

Good to know ! So... in order to squeeze more shoot_malloc memory, do we can play with this ? --> https://bitbucket.org/hudson/magic-lantern/commits/39d536e2b72c39b81855526fbd08f4281931ccbb     what do you think ?
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 05, 2013, 01:21:21 AM
This is my test with 550D Raw at 1024x448 "without" problems while recording. Sometimes camera stops recording at frame 70-80, but after that I can record without problems. I see a lot of issues but what else can we expect? Less aliasing? more resolution? I still watch a lot of artifacts but I hope someday this can improve thanks to all developers around here!!! Thank u all for your work, it´s amazing!
Title: Re: 550D raw video recording port official thread
Post by: wharfrat22 on June 05, 2013, 01:48:47 AM
Looks really nice.  May I ask what lens you are using? This thread has taught me a great deal.  Thanks to all that has contributed.  Very inspiring.
Title: Some Low-Light test shots
Post by: igouroum on June 05, 2013, 04:35:15 AM
Being in Paris for a few days, I decided to shoot some test videos, mostly at night.
Didn't have any tripod / Slider, etc on me as I didn't have much room to spare, but decided to shoot
something regardless at about 1am.
So yeah.. check it out and tell me what you think! Feel free to ask any questions, I'll answer within a couple of hours.
Also, read the description!

http://www.youtube.com/watch?v=eHfpKQzgCL0

Cheerios,

Marc Wolff
Title: Re: 550D raw video recording port official thread
Post by: GregoryOfManhattan on June 05, 2013, 05:00:25 AM
try for 50D NSTUB( 0xff9829b0, FIO_SeekFile)

first build with FIO_SeekFIle that has worked - thank you - @Chucho explained in another thread about offsets from the 1.07 firmware and calculated with a couple of bytes of your value.  raw_rec module runs and plays back on 50D.
thank you.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 05, 2013, 05:06:57 AM
first build with FIO_SeekFIle that has worked - thank you - @Chucho explained in another thread about offsets from the 1.07 firmware and calculated with a couple of bytes of your value.  raw_rec module runs and plays back on 50D.
thank you.
Awesome thats is great!
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 05, 2013, 07:25:57 AM
My first try at RAW video with 5x zoom and kit lens zoomed all the way out to 18mm.


Description: 1:1 crop from sensor so there's no aliasing or moire from line skipping. Recorded @ 1024x448 and upscaled with Instant HD to 1280x560.  Minor color correction and sharpening in ACR.  Shot with the crappy kit lens (EF-S 18-55mm).

Any one else getting the pink corrupted frames more in 5x mode?  Is there any way to get the box to display right in 5x mode?

Update: As soon as I posted this here, YouTube removed the 720p option...

Update 2: YouTube removed the 720p option at 1280x560 so I resized this one to 1646x720 in After Effects in High Quality hoping YouTube would keep the 720p option this time.  Embed code linked to new video.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 05, 2013, 09:15:37 AM
guys, how do you embed videos in posts?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 05, 2013, 09:47:01 AM
guys, how do you embed videos in posts?

This button should help:
(http://ipic.su/img/img7/fs/kiss_23kb.1370417255.jpg)
Just paste the link between the [youtube] tags.
Title: Re: 550D raw video recording port official thread
Post by: Videoteq on June 05, 2013, 10:24:40 AM
guys, how do you embed videos in posts?

With all due respect - this thread is about 550D Raw Video - please keep posts pertinent to the subject.

Thanks
Rob
Title: Re: 550D raw video recording port official thread
Post by: JoshuOne on June 05, 2013, 10:48:39 AM
Greetings
Mk111174, you stated yesterday that the 500d is getting 1280x400+ at 24fps, is this in raw?  How?  I have been trying to find a thread on the 500d raw and have been unsuccessful, please turn me in right direction.  Thanks and please don't be angry if there was somewhere else to post this.  Thank you.
Title: Re: 550D raw video recording port official thread
Post by: sharpshooter on June 05, 2013, 02:44:14 PM
I've been testing with the ML_Fileman_Raw_Tragic (http://www.mediafire.com/download/96zgrdjaubamjuh/ML_Fileman_Raw_Tragic.zip) build and sometimes all I get is a bunch of weird frames like this:

(http://i.imgur.com/7MhtFEy.jpg)

This clip was shot at 1728x992 @ 5fps in PAL mode (does that even matter here?), it has already happened when I tried to use the 5x Mode.

What can be causing this ?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 05, 2013, 07:13:13 PM
I've been testing with the ML_Fileman_Raw_Tragic (http://www.mediafire.com/download/96zgrdjaubamjuh/ML_Fileman_Raw_Tragic.zip) build and sometimes all I get is a bunch of weird frames like this:

(http://i.imgur.com/7MhtFEy.jpg)

This clip was shot at 1728x992 @ 5fps in PAL mode (does that even matter here?), it has already happened when I tried to use the 5x Mode.

What can be causing this ?
These are just random bugs, I get this every so often especially when doing 5x mode no matter what build I use. I also get them more using fps hack. Every camera model is probably differ though so it might be something that will never be fixed or might be something that gets fixed by coincedence one day. I just delete these frames when they happen, I am so happy with Raw video now that I can risk losing a few frames here and there.

I am not a developer so I am just like most of us in here, just guessing at what is wrong. The real smart ones are Alex and 1% those dude know what they are doing!
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 05, 2013, 07:14:45 PM
Greetings
Mk111174, you stated yesterday that the 500d is getting 1280x400+ at 24fps, is this in raw?  How?  I have been trying to find a thread on the 500d raw and have been unsuccessful, please turn me in right direction.  Thanks and please don't be angry if there was somewhere else to post this.  Thank you.
Are you saying you need a bin for your 500D? I would be glad to share.
Title: Re: 550D raw video recording port official thread
Post by: CharlieA56 on June 05, 2013, 09:28:54 PM
500D ????... RAW ????...  :o
Where ???... Where ???...
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 05, 2013, 09:38:24 PM
exmem.c - line around 147 -
hsuite = shoot_malloc_suite (max_size + backup_size - 8 * 1024 * 1024)
in this manner, the old version, we obtain 68Mb of shoot memory, good to serve as buffer for raw video (more memory, more resolution)
-----------------------------------------------------------------------------------------
hsuite = shoot_malloc_suite (max_size + backup_size - 1024 * 1024)
in this manner, the new and current version, we obtain 75Mb of shoot memory
-----------------------------------------------------------------------------------------
Our goal is to raise this shoot memory as high as possible, but the maximum I managed to obtain is :
hsuite = shoot_malloc_suite (max_size + backup_size)
in this manner, we can have 76Mb of shoot memory
Then, following this way... if you try  even a :
hsuite = shoot_malloc_suite (max_size + backup_size + 1024 * 1024)
the result is 0 of shoot memory !
-----------------------------------------------------------------------------------------

I have hitted a wall here...  :'(

From a technical point of view, this thread is quite dead ! C'mon guys ! If you are trying something, no matter what are the results, share them with me so we can publish the efforts of all in order to progress !  ;)
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 05, 2013, 10:14:09 PM
What is the error 70 you got.. you can patch it at boot time with a cache hack (maybe after too if you're lucky).

You can also try to boot with asserts disabled for the time being and see if it works.
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 05, 2013, 10:20:56 PM
Before patching errors, make sure you fully understand what you are doing. If you brick the camera, you get to keep both pieces. If you brick other user's cameras, they will blame ML.

Quote
patching asserts is like putting a tube on your open wound so you don't see yourself bleeding to death anymore
(but you're still bleeding to death)
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 05, 2013, 10:31:25 PM
Yep... even with no assert might boot to black LV. Sraw may not work here... or may not free any memory.

We need to understand SRM_ChangeMemoryManagementforXXX and figure out how to free memory afterwards.

Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 12:59:11 AM
- Modifying the "backup_size" (by upsizing or downsizing it), doesn't sort any effect at all.
- Changing the probe size from 4 to 2 and then to 1 (just to dig out more memory chunks), doesn't sort any effect at all.
- Forcing "size" to zero into the shoot_malloc allocation function, just to force it to allocate the maximum size, takes the camera to stack overflows and freezes that need to pull out the battery: no luck...
Title: Re: 550D raw video recording port official thread
Post by: JoshuOne on June 06, 2013, 01:46:13 AM
Greetings, I would be very grateful for  a bin that allows raw video on my 500d. Thanks so much for the offer.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 06, 2013, 04:00:36 AM
Greetings, I would be very grateful for  a bin that allows raw video on my 500d. Thanks so much for the offer.
http://www.mediafire.com/download/550t5lt67q0vc3w/500D_Raw_ML.zip
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 06, 2013, 05:33:29 AM
- Modifying the "backup_size" (by upsizing or downsizing it), doesn't sort any effect at all.
- Changing the probe size from 4 to 2 and then to 1 (just to dig out more memory chunks), doesn't sort any effect at all.
- Forcing "size" to zero into the shoot_malloc allocation function, just to force it to allocate the maximum size, takes the camera to stack overflows and freezes that need to pull out the battery: no luck...


I think we can gain a few more extra frames (on 550D at least), if we are a little bit more permissive with the current waste recycling mechanism:

Code: [Select]
/* try to recycle the waste */
    if (waste >= 8*1024*1024 + 8192)
    {
        buffers[buffer_count].ptr = (void*)(((intptr_t)(fullsize_buffers[0] + buf_size) + 4095) & ~4095);
        buffers[buffer_count].size = waste - 8192;
        buffers[buffer_count].used = 0;
        buffer_count++;
        total += waste;
    }

Let's say we can use those chunks from the remaining, which are larger than 8Mb. Because on the 550D we have ~75Mb shoot_malloc, and with the two ~31Mb contiguous buffers only,we left unused around 10Mb.

And I think it's better if the buffers are in ascending order (start writing ASAP):
Code: [Select]
/* Sort Buffers */
    static struct buff temp[10];
    for (int i = 0; i < buffer_count; i++)
        for(int j = 0; j < buffer_count- i - 1; j++)
           if(buffers[j].size > buffers[j + 1].size)
           {
                temp[j] = buffers[j];
                buffers[j] = buffers[j + 1];
                buffers[j + 1] = temp[j];
           }

(It seems it's no longer in the unified?)


Some test results here, on 550D with SanDisk ExtremePro 16GB, at 1280x426 @ 24fps without HaCKeD mode:

Buffers                 FramesSeconds
2x31Mb68<3
2x31Mb + 9Mb26511
9Mb + 2x31Mb27411.4

My version is probably not up to date, so take this into account!
And I don't know how it may affect the other models btw, need reviews...

dlrpgmsvc: Just to make you happy  :D ;D

a1ex please confirm these!

Forgive me if I wrote stupid things :D and apologize for my english :D
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 06, 2013, 05:43:55 AM
Possible. 8MB buffers are slowing down stuff on high-end cameras though.

Did you try this tool? https://bitbucket.org/hudson/magic-lantern/src/tip/modules/raw_rec/speedsim.py
Title: Re: 550D raw video recording port official thread
Post by: JoshuOne on June 06, 2013, 05:58:28 AM
Thanks so much, mk111174. When I go to load the modules I get an error:
tcc: error: undefined symbol 'FIO_SeekFile"
[E] failed to link modules

This is as close as I have come to being able to use the RAW Video, so I am very grateful and excited, if someone could help me get past this error, I would really appreciate it. Thanks again, mk11174!
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 06, 2013, 06:04:33 AM
Yea, might be opposite on 550D, sort how you need to. Mainly its for 32m buffers vs like 29m.. not 9m. I tried sorting both ways too.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 06, 2013, 08:03:14 AM
Thanks so much, mk111174. When I go to load the modules I get an error:
tcc: error: undefined symbol 'FIO_SeekFile"
[E] failed to link modules

This is as close as I have come to being able to use the RAW Video, so I am very grateful and excited, if someone could help me get past this error, I would really appreciate it. Thanks again, mk11174!
OOh sorry, need to add the seek file address I forgot it was not added to unified yet. I will rebuild for you.

http://www.mediafire.com/download/sdjy758pczkp62c/500D_Raw_ML_FIX.zip
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 08:26:39 AM
@xaint: Many thanks! What is the source file dealing with waste mechanism ? And the one dealing with buffers sorting? At what line number is to insert the sorting code, now not present in the unified? I think we can add a #ifdef 550d for all this things and for my 1mb squeezing in exmem.c , what do you think?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 06, 2013, 08:39:29 AM
Sorting might help with very small buffers when you have to write 100-200 frames or so (e.g. a particular write speed may work better with a particular buffer order), but will not help at all for continuous recording. Use my python script and run some simulations.

You can't ifdef in raw_rec, and 1MB squeeze at the cost of maybe not working at all... I wouldn't recommend.
Title: Re: 550D raw video recording port official thread
Post by: JoshuOne on June 06, 2013, 08:44:25 AM
Thanks so much, mk11174. I will let you all know how it goes on the old 500d!!!
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 06, 2013, 12:25:13 PM
Sorting might help with very small buffers when you have to write 100-200 frames or so (e.g. a particular write speed may work better with a particular buffer order), but will not help at all for continuous recording. Use my python script and run some simulations.

You can't ifdef in raw_rec, and 1MB squeeze at the cost of maybe not working at all... I wouldn't recommend.

Yeah I know this isn't ,,The Solution" for continuous recording, it only delays the ,,buffer overflow", but it is at least a few seconds plus recording time.

Until we figure out how to get more memory (if it is possible at all on 550D), this is something at least. :)

I didn't try that speedsym script, but I will!

dlrpgmsvc: about 1mb squeezing in exmem.c: I agree with a1ex: 1MB squeeze at the cost of maybe not working at all... I wouldn't recommend.
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 06, 2013, 04:05:07 PM
Guys, is there any location where all the builds for 550d are located? Ive searched around for it but it seems that it isnt located anywhere on separate topic. Is it possible to update the first post in this thread with latest builds?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 07:32:57 PM
Guys, is there any location where all the builds for 550d are located? Ive searched around for it but it seems that it isnt located anywhere on separate topic. Is it possible to update the first post in this thread with latest builds?

Sure ! If mk11174 give me his permission, I will publish the links to his builds about 550D on the first post ! Good idea ! Thanks !
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 06, 2013, 07:35:35 PM
Sure ! If mk11174 give me his permission, I will publish the links to his builds about 550D on the first post ! Good idea ! Thanks !
Do It! LOL  ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 08:01:54 PM
Done ! Thanks !  8)
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 06, 2013, 08:20:08 PM
Video Test using 550D ;)

Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 09:06:15 PM
Am I the only fool here that discovered HDR RAW VIDEO is already enabled and operative, and it also works on 550D ?  8)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 06, 2013, 09:51:44 PM
Another build with the help of Xaint getting us a bit more memory for recording, I am getting much more frames before skipping now with 1280x432x24p 193 frames to be exact, was only getting 86 before his hack.

This also includes Alex's latest bitbuckit update, gives us more resolution choices looks like and a mem hack but doesnt seem to help our cam at all.

http://www.mediafire.com/download/09bl5v3ovzca5c7/ML_Raw_MemFix.zip

This includes Filemanager as will, you can find in the Debug menu.
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 06, 2013, 10:04:08 PM
Video Test using 550D ;)


Really nice shots! Long shots too! Can you share your set up and workflow?

Thanks for sharing
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 06, 2013, 10:11:05 PM
Another build with the help of Xaint

Congratulations to both ! Meanwhile, I updated the head post by adding also this release !
If I can be of help, let me know !

PS: do you will pull your memory improvements to the repo ?  :)
Title: Re: 550D raw video recording port official thread
Post by: Pharinen on June 07, 2013, 12:13:26 AM
I will try(i don't promise anything) to do test comparison between 5Xraw, raw and h.264(bitrate 3.0x) tomorrow. Let's see can you guys tell a difference ;)

I will try to match the scene, DOF, colours etc. best as I can.

Why I'm telling this? Because then I have some reason to do this test, other wise I would probably move it tomorrow and then again tomorrow etc. You know what I mean. Now I have social pressure to do this, I can't let you guys down. :D  ::)

E: Comparison will come next week...
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 07, 2013, 12:37:54 AM
Really nice shots! Long shots too! Can you share your set up and workflow?

Thanks for sharing

Sure, I used the 2.35 ratio, 1024x448, Global Draw off. SD card is a Transcend 16gb class 10. Lense is the Kit Lens 18-55 IS II with an ND8 filter.

I used Rawanizer to extract the DNG, then I imported,graded and exported every files in Lightroom 4.
I finally used Sony Vegas to make the final video rendered at 1280x720 24fps.
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 07, 2013, 01:32:41 AM
I can not achieve good results with this. All shots that I take are with too much noise (even with ISO 100) and after I try to use noise reduction in ACR and a bit of sharpening, loaded frames in AE are still noisy. And every frame is a bit different, you can see like a noise movement all across the final render. Dont know if Im doing something wrong here. I tried both kit lense and 50mm 1.8 II.
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 07, 2013, 01:39:50 AM
Another build with the help of Xaint getting us a bit more memory for recording, I am getting much more frames before skipping now with 1280x432x24p 193 frames to be exact, was only getting 86 before his hack.

This also includes Alex's latest bitbuckit update, gives us more resolution choices looks like and a mem hack but doesnt seem to help our cam at all.

http://www.mediafire.com/download/09bl5v3ovzca5c7/ML_Raw_MemFix.zip

This includes Filemanager as will, you can find in the Debug menu.

Thanks for this upload but unfortunatlely there is not enough choices in 2.35 resolution format. There is no 1024*450 choice, it's 1180 and then the next lower resolution is 980x....
Can you include a resolution in the 1024 range ( so we can record at around 18,5Mbit / sec ? )

Thanks ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 07, 2013, 02:02:02 AM
Thanks for this upload but unfortunatlely there is not enough choices in 2.35 resolution format. There is no 1024*450 choice, it's 1180 and then the next lower resolution is 980x....
Can you include a resolution in the 1024 range ( so we can record at around 18,5Mbit / sec ? )

Thanks ;)
That is the version from the unified, does the tragic lantern version have the size you want, I can do a tragic-lantern build with the mem patch.
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 07, 2013, 06:41:00 AM
on the new build

http://www.mediafire.com/download/09bl5v3ovzca5c7/ML_Raw_MemFix.zip

Getting the following

1280x640 - 56frames
960x480 - 101frames
864x432 - 126frames
768x384 - 222frames

before Getting
960x544 - 71frames

thanks for more frames!!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 07, 2013, 10:10:55 AM
Now i'm getting stable 1280x536 (lovely 1:2.4 cinemascope ratio) at 18 fps, and with some effort and tricky twixtoring, i'm pretty sure i can shoot the whole short film entirely within the RAW workflow.

With all the fine detail, dynamic range, beautiful color reproduction and other flexibilities, we can now get a bunch of really shiny shots, guys.
Another color test: https://vimeo.com/67710667

A couple of tests with motion and slightly moving objects. As you can see, this technique theoretically can handle some more complex motion, so this is promising:

My current workflow:
- movie mode with overlays off
- 1280x536 18fps or 1344x576 15fps
- minimal possible ISO of course (for day outdoors usually i use iso 100-0.3 ml ev = 80)
- shutter speed for filmic look is obviously dictated by 180 degrees rule, so it should be around 1/40 - 1/50 sec. (if you are planning using some time remapping plugins like twixtor, the shutter speed shoud remain the same for natural motion blur, regardless of actual fps you are shooting on).
- Raw2DNG
- Initial and most thorough grading in Adobe Camera RAW
- Importing DNG's directly to AE (my slightly overclocked core i7 930 is enough for short tests, but for longer sequences i will use exporting to 16bit tiffs or smth)
- Twixtor pro to frame rate conversion.

Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 07, 2013, 10:25:36 AM
The last build it's giving me better results for the first 200 frames, but then I get drops more often than before. I'm using a Transcend class10 16gb
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 07, 2013, 11:19:28 AM
Got a crash after first time launch with this build. No issues afterwards, but my fav resolution width 1408 is gone.. Will have to downgrade
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 07, 2013, 11:22:15 AM
Now i'm getting stable 1280x536 (lovely 1:2.4 cinemascope ratio) at 18 fps, and with some effort and tricky twixtoring, i'm pretty sure i can shoot the whole short film entirely within the RAW workflow.

With all the fine detail, dynamic range, beautiful color reproduction and other flexibilities, we can now get a bunch of really shiny shots, guys.
Another test: https://vimeo.com/67710667

 Looks great. Can you describe your workflow, please? Do you shoot in picture or movie mode, at what shutter speed and ISO? Raw2DNG to AE? When do you grade, in ACR or after you import dngs to AE?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 07, 2013, 11:57:52 AM
Got a crash after first time launch with this build. No issues afterwards, but my fav resolution width 1408 is gone.. Will have to downgrade
See my newest post
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 07, 2013, 12:02:40 PM
Anyone having hard time deciding which record module they like best out of Magic Unified vs the Tragic version, this will help you.

http://www.mediafire.com/download/9v3l9lxfnmvbffg/Raw_MODULES.zip

Just use my latest bin to make sure your up to date on everything, but go into the ML/Modules folder on your card and delete raw_rec.mo and add these 2 files that are in this zip. You will have 2 new option within Magic Lantern.

When you decide which you like best, just delete the other module or just keep both, your choice.
Title: Re: 550D raw video recording port official thread
Post by: e-man on June 07, 2013, 12:24:23 PM
Anyone having hard time deciding which record module they like best out of Magic Unified vs the Tragic version, this will help you.

http://www.mediafire.com/download/9v3l9lxfnmvbffg/Raw_MODULES.zip

Just use my latest bin to make sure your up to date on everything, but go into the ML/Modules folder on your card and delete raw_rec.mo and add these 2 files that are in this zip. You will have 2 new option within Magic Lantern.

When you decide which you like best, just delete the other module or just keep both, your choice.

For me tragic if that one was with more resolution options.
here is my test.
in 720p mode got 1088x416 25fps continius
there are some pixels wrong is there any explanation why so? maby 720 mode?

but with the one from notdabod
i can get 1244x360 25fps at 720 mode


Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 07, 2013, 02:36:14 PM
Excuse my silly question, but: how to record raw in 1:1 crop mode, so no line skipping ? And how to record raw in no-crop mode (with line skipping??) ? Do "no crop mode" equals to line skipping entering into play ? many thanks !  ::)
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 07, 2013, 03:38:39 PM
Excuse my silly question, but: how to record raw in 1:1 crop mode, so no line skipping ? And how to record raw in no-crop mode (with line skipping??) ? Do "no crop mode" equals to line skipping entering into play ? many thanks !  ::)

I'm not sure I understand the question but: In crop mode (5x, press focusing zoom on the camera and record from there) there is no line skipping. When the camera is not zoomed in (no-crop mode?), Canon's firmware reads some lines only.

Anyone having hard time deciding which record module they like best out of Magic Unified vs the Tragic version, this will help you.

http://www.mediafire.com/download/9v3l9lxfnmvbffg/Raw_MODULES.zip

Just use my latest bin to make sure your up to date on everything, but go into the ML/Modules folder on your card and delete raw_rec.mo and add these 2 files that are in this zip. You will have 2 new option within Magic Lantern.

When you decide which you like best, just delete the other module or just keep both, your choice.


The more resolutions are available for our slow cameras... the better. Thanks!
Title: Re: 550D raw video recording port official thread
Post by: pooli on June 07, 2013, 06:30:10 PM
Hi, I don't understand. downloaded here is the new raw2DNG
https://bitbucket.org/hudson/magic-lantern/downloads/raw2DNG.exe
converts with stripes  :(

(http://i057.radikal.ru/1306/e2/e0f7a5d7c7fd.jpg)
   
my old Converter makes it better!

(http://s017.radikal.ru/i431/1306/86/bf8b3d856e7c.jpg)
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 07, 2013, 08:15:43 PM
I got no love in "Share your videos" so I'll post it here as well.  I was trying to see if it's worth upscaling footage that's 1024x448 to 1080p or 1920x840 and here was my result.


Note:  I don't recommend scaling up to 1080p if you aren't using 5x mode.  When you use 5x mode you aren't hurting the resolution from line skipping so it scales much nicer.  If you aren't using it, just scale to 720p imo.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 07, 2013, 08:41:33 PM
I got no love in "Share your videos" so I'll post it here as well.  I was trying to see if it's worth upscaling footage that's 1024x448 to 1080p or 1920x840 and here was my result.

The video you posted is 1920x840 (there are horizontal black bands in the upper and lower part): can you post a real 1920x1080 upscalig, just to taste it ? Many thanks !  ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 07, 2013, 08:45:52 PM
Now i'm getting stable 1280x536 (lovely 1:2.4 cinemascope ratio) at 18 fps, and with some effort and tricky twixtoring, i'm pretty sure i can shoot the whole short film entirely within the RAW workflow.

With all the fine detail, dynamic range, beautiful color reproduction and other flexibilities, we can now get a bunch of really shiny shots, guys.
Another color test: https://vimeo.com/67710667


Marvelous !  ;)
Title: Re: 550D raw video recording port official thread
Post by: Alex546 on June 07, 2013, 09:30:50 PM
Thank you for the new version!
I get 1280x544 with 24 fps with Tragic RAW in 720p mode.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 07, 2013, 10:28:41 PM
A very stupid question :

Testing raw video...
In Canon video mode i cannot set the shutter speed, ML bottom display says that it's fixed to 1/6 sec !
In Canon photo M mode I can set the shutter speed, ML bottom display says it's the value i'm setting, but at all effects it's overridden to 1/6 sec, and this is visible in the lv simulation and also in the playback !

Why !   :o

update : it's because i set fps override equal to 5fps... but why i cannot set a 1/1000 sec shutter speed with 5fps ? it should be perfectly legal...
Title: Re: 550D raw video recording port official thread
Post by: glubber on June 07, 2013, 11:03:30 PM
@pooli: i made the same experience today, that an older version of raw2dng works better than the newest build for my 550D footage. But i'm not sure it's an result of other parameters (green and red pixels) so i stick for the old one for now.

The video you posted is 1920x840 (there are horizontal black bands in the upper and lower part): can you post a real 1920x1080 upscalig, just to taste it ? Many thanks !  ;)

1920x840 is 1:1.875 aspect ratio, where as 1920x1080 is 1:1.78. So to get a heigth of 1080 the width must be cropped from 2025 to 1920. ;)


.
A very stupid question :

Testing raw video...
In Canon video mode i cannot set the shutter speed, ML bottom display says that it's fixed to 1/6 sec !
In Canon photo M mode I can set the shutter speed, ML bottom display says it's the value i'm setting, but at all effects it's overridden to 1/6 sec, and this is visible in the lv simulation and also in the playback !

Why !   :o

update : it's because i set fps override equal to 5fps... but why i cannot set a 1/1000 sec shutter speed with 5fps ? it should be perfectly legal...

Ha! Just as i was quoting you, in order to give You a hint about FPS override, You gave yourself the right answer. LOL
Its not possible to vary shutterspeed in normal way while using FPS override. You can choose some variation of shutterspeed in Advanced options of override: opt for low light = 360°, low jello = 180°.
Title: Re: 550D raw video recording port official thread
Post by: sharpshooter on June 07, 2013, 11:15:40 PM
For some reason this isn't working very well for me...
Apparently my Samsung 16GB Class 10 SDHC is below average in terms of speed.

I've tried every build posted here, and the more I test it the more I get shots only made of weird frames like this one I posted before:
(http://i.imgur.com/7MhtFEy.jpg)

How can this be ? At the first shots it worked just like expected, but now regardless of what build I try or settings, at this point 90% of all shots just end like that  :-\
Title: Re: 550D raw video recording port official thread
Post by: sharpshooter on June 07, 2013, 11:16:45 PM
(DOUBLE POST... MY BAD  :-\)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 07, 2013, 11:53:05 PM
Ha! Just as i was quoting you, in order to give You a hint about FPS override, You gave yourself the right answer. LOL
Its not possible to vary shutterspeed in normal way while using FPS override. You can choose some variation of shutterspeed in Advanced options of override: opt for low light = 360°, low jello = 180°.

Yep ! Many thanks ! I solved by setting "Hi Jello, fast Tv" ! Now I can do the experiments I want to do. If someone wants to follow me, it's good ! So:

[1] Set raw video resolution to 1920x1080, 16:9 - 1080p FullHD standard - (you can achieve this by entering 5x zoom Live View BEFORE enabling RAW video)
[2] Set override fps to 5fps (the maximum our little 550D can do at that raw resolution without loosing frames) and enable, in the same menu, "Hi Jello, fast TV"
[3] Set shutter speed to 1/300 or so... however keep it high
[4] Film... try not to pan too fast, at least to do this experiment... because too jello will ruin the video

Then, you have a quite Jumpy video, but at least the frames are not smeared down by the 1/6 sec shutter speed that you are forced to without enabling "Hi jello, fast Tv" in fps override menu. But no problem: now fire up Twixtor and interpolate up to 24fps, then sit back and render. Then... good vision of the final product !

If someone will beat me publishing his results, he is so much welcome !  8)
(If it will work, I give you the permission to call it "dlrpgmsvc 550D RAW fullHD method) !  :P
Title: Re: 550D raw video recording port official thread
Post by: moscow on June 08, 2013, 01:01:06 AM
Hahaha, dlrpgmsvc, It sounds great. Well, trying it now :D
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 08, 2013, 03:26:11 AM
I havent tryed the new memory fix update but for some reason today i went out on a colder day, and i got alot better frames and better qualityshots. I will install the memory fix soon to see how much of an improvement but i got 24fps almost upto full 720p. I was shocked, I bet i can get upto full 720 or more will test in a few. Im about to upload a video now
Modes used are 1152 x 384         1088 x 416           1280  x 432     

Theres so much detail in the clouds I love raw!
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 08, 2013, 05:25:51 AM
Thank you for the new version!
I get 1280x544 with 24 fps with Tragic RAW in 720p mode.

REALLY? You mean 544 after stretching from 326, don't you?

Native 1280*544 is the maximum I expect from our camera if we ever get 10bit Raw
Yep ! Many thanks ! I solved by setting "Hi Jello, fast Tv" ! Now I can do the experiments I want to do. If someone wants to follow me, it's good ! So:

[1] Set raw video resolution to 1920x1080, 16:9 - 1080p FullHD standard - (you can achieve this by entering 5x zoom Live View BEFORE enabling RAW video)
[2] Set override fps to 5fps (the maximum our little 550D can do at that raw resolution without loosing frames) and enable, in the same menu, "Hi Jello, fast TV"
[3] Set shutter speed to 1/300 or so... however keep it high
[4] Film... try not to pan too fast, at least to do this experiment... because too jello will ruin the video

Then, you have a quite Jumpy video, but at least the frames are not smeared down by the 1/6 sec shutter speed that you are forced to without enabling "Hi jello, fast Tv" in fps override menu. But no problem: now fire up Twixtor and interpolate up to 24fps, then sit back and render. Then... good vision of the final product !

If someone will beat me publishing his results, he is so much welcome !  8)
(If it will work, I give you the permission to call it "dlrpgmsvc 550D RAW fullHD method) !  :P

I think twixtoring 5fps to 24 fps is waaay too much. I'm getting better results upscaling, rather than twixtoring from 12 to 24fps.
Title: Re: 550D raw video recording port official thread
Post by: blazraidr on June 08, 2013, 10:07:46 AM
Thank you everyone who was involved in making RAW happen on the 550D! The video quality is so amazing, my jaw actually dropped when I saw the first previews.

The maximum I can get my 550D to record at RAW is 1280x432 at 22fps. This is not with the most recent build though. I'm actually satisfied with that resolution.

Here are a few of my tests.



Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 08, 2013, 12:09:06 PM
Here are a few of my tests.

Please, can you do again a comparison raw vs h.264 BUT with ML bitrate cranked up to maximum ? Or h.264 standard vs h.264 cranked to max with ML vs raw all in one test ! Nobody done this so far, so we can decide if raw is really Worth the work to assemble it ! Keep the comparison method you used in your previous test, also with the slanted stripe running across horizontally ! Many thanks !  ;)
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 08, 2013, 12:30:56 PM
Thank you for the new version!
I get 1280x544 with 24 fps with Tragic RAW in 720p mode.

 60 frames?
Title: Re: 550D raw video recording port official thread
Post by: vincentparker on June 08, 2013, 12:33:09 PM
is it possible to to go for maybe a lower bit depth? or would this reduce the number of frames you can get in one shot?  i feel even 12-bit could be amazing. I know 14 = better quality but at the same time maybe we are trying to push ability too far for the 550D
Title: Re: 550D raw video recording port official thread
Post by: otherman on June 08, 2013, 12:35:12 PM
Can someone post raw footage in 1280*xxx at 12fps with no zoom? (The file output from camera, without any modification)
I want to make some tests with Avisynth to find best way to remove aliasing, interpolate to 24fps, and upscaling to 1080p, but I've not a fast SD card right now.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 08, 2013, 12:36:24 PM
is it possible to to go for maybe a lower bit depth? or would this reduce the number of frames you can get in one shot?  i feel even 12-bit could be amazing. I know 14 = better quality but at the same time maybe we are trying to push ability too far for the 550D

You can follow the thread here : http://www.magiclantern.fm/forum/index.php?topic=5601.msg47379#msg47379   ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 08, 2013, 04:50:38 PM
Can someone post raw footage in 1280*xxx at 12fps with no zoom? (The file output from camera, without any modification)
I want to make some tests with Avisynth to find best way to remove aliasing, interpolate to 24fps, and upscaling to 1080p, but I've not a fast SD card right now.

Sure ! And when you managed to sort this out, let me know (send me a pm, please!) and also the community in the dedicated RAW post-processing thread ! Many thanks in advance ! Here is a sample file 1280x768x12fps ----> https://dl.dropboxusercontent.com/u/46130896/1280x768x12fps.RAW     8)

Hint : Crop all the frames, first of all, before any intervention, to 1280x720, so you obtain 16:9 aspect ratio, good for 1080p that is 1920x1080 ! Take care !  ;)
Title: Re: 550D raw video recording port official thread
Post by: Alex546 on June 08, 2013, 04:57:21 PM
REALLY? You mean 544 after stretching from 326, don't you?

Yes I mean 326, streched to 544, Sorry! :-\
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 08, 2013, 05:40:03 PM
Is there a way to stop live-view from shutting down automatically after few seconds because everytime I record RAW video it happens and it's pretty boring !

Also I noticed that the RAW module doesn't save the last resolution setting I used, is there a way to keep the resolution by default at 1280*450 for exemple?

Thanks for the help
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 08, 2013, 05:52:39 PM
Is there a way to stop live-view from shutting down automatically after few seconds because everytime I record RAW video it happens and it's pretty boring !

You must go to Canon menu and find the automatic shutdown timer, then set it to a longer timeout or disable it. I have done the same by disabling it ! Good for photo works, no good for video works !   ;)
Title: Re: 550D raw video recording port official thread
Post by: Alex546 on June 08, 2013, 06:36:49 PM
Also I noticed that the RAW module doesn't save the last resolution setting I used, is there a way to keep the resolution by default at 1280*450 for exemple?

Currently, the modules can't save data.
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 08, 2013, 06:37:33 PM
hi guys

iam very sick in this days:-(but here is my 1280*544 Test.


sorry for bad cuts..

when my illness is gone i will shoot some max resolution test

and the good news the 550D has more power than 21.3mbs
i will work on this!!
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 08, 2013, 06:47:46 PM
Thanks ;)
Title: Re: 550D raw video recording port official thread
Post by: otherman on June 08, 2013, 07:06:09 PM
Hi, I don't understand. downloaded here is the new raw2DNG
https://bitbucket.org/hudson/magic-lantern/downloads/raw2DNG.exe
converts with stripes  :(

(http://i057.radikal.ru/1306/e2/e0f7a5d7c7fd.jpg)

I've the same problem, with all version of raw2dng. Any suggestions?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 08, 2013, 07:15:48 PM
and the good news the 550D has more power than 21.3mbs
i will work on this!!

wow ! but how you overcome the sd controller max speed  ? ???  :o
Give us some clues !  ;)
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 08, 2013, 07:20:31 PM
@dlrpgmsvc

i didnt overcome the limit yet!!
but my friend the electronic hardware ingeneer says the the problem is by the controller.
we will disasample the controller from the rest and take look what we can do.according to the memory bechnmark the cam is defently faster than the sd controller!
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 08, 2013, 10:24:27 PM
An Other Test

Title: Re: 550D raw video recording port official thread
Post by: laconiccrusader on June 08, 2013, 10:34:16 PM
here's my little 2:40 video, i tried shooting a lot of different things to test out how the RAW is doing :
landscapes, macro, people, buildings etc..
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 08, 2013, 11:21:09 PM
Anyone having the problem when raw is enabled not being able to go from 5x to 10x then back to normal without camera crashing?
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 08, 2013, 11:22:27 PM
here's my little 2:40 video, i tried shooting a lot of different things to test out how the RAW is doing :
landscapes, macro, people, buildings etc..
that looks amazing the best footage I've seen so far good job
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 08, 2013, 11:23:12 PM
Anyone having the problem when raw is enabled not being able to go from 5x to 10x then back to normal without camera crashing?
Yeah, known issue, just disable 10x zoom in ML live zoom settings, that is what I do.
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 08, 2013, 11:46:18 PM
An Other Test


I included the good link now !
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 09, 2013, 12:38:09 AM
@dlrpgmsvc

i didnt overcome the limit yet!!
but my friend the electronic hardware ingeneer says the the problem is by the controller.
we will disasample the controller from the rest and take look what we can do.according to the memory bechnmark the cam is defently faster than the sd controller!
Very very good! Keep me and community informed about future developments on this! Thanks!
Title: Re: 550D raw video recording port official thread
Post by: D.L. Watson on June 09, 2013, 01:44:43 AM
Thanks so much for allowing this feature on the T2i. My video below shows a comparison between H.264 and the RAW shooting indoors through a window.

The flexibility is amazing.


I ended up lowering the fps to increase resolution. I was able to shoot for about 300+ frames at 1600x672 (2.39:1) at 12fps. Twixtor has no problem filling in the missing data. I used Instant HD to bring the footage up to 1920x806.

Ill have to do more tests. I'm hoping there will be a way to unlock the limitations on the write speed on the port - if so - Ill have to seriously rethink a purchase of the Pocket Cinema Camera.
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 09, 2013, 03:19:24 AM
So how big are the raw files you guys are shooting??
Title: Re: 550D raw video recording port official thread
Post by: D.L. Watson on June 09, 2013, 03:39:58 AM
So how big are the raw files you guys are shooting??

Over 500mb for 303 frames
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 09, 2013, 04:38:57 AM
I ended up lowering the fps to increase resolution. I was able to shoot for about 300+ frames at 1600x672 (2.39:1) at 12fps. Twixtor has no problem filling in the missing data. I used Instant HD to bring the footage up to 1920x806.
What workflow did you use for Twixtoring+Instant HD? I tried using both in AE (Instant HD on a Solid and Twix on the clip), but it rendered without the Twixtoring. So I had to use a twixtored intermediate which I upscaled with Instant HD, but I would like to save some time by avoiding this extra step.
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 09, 2013, 04:40:18 AM
double post
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 09, 2013, 05:05:13 AM
Yeah, known issue, just disable 10x zoom in ML live zoom settings, that is what I do.

ok thank you i didnt know u could do that. i need to start testing all the new features i still havent mastered the follow focus on the dslr.
or the hdr ill have to go look into the info
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 09, 2013, 05:08:14 AM
So how big are the raw files you guys are shooting??

huge files 1gb raw is about 200mb of h247
Title: Re: 550D raw video recording port official thread
Post by: D.L. Watson on June 09, 2013, 06:00:11 AM
What workflow did you use for Twixtoring+Instant HD? I tried using both in AE (Instant HD on a Solid and Twix on the clip), but it rendered without the Twixtoring. So I had to use a twixtored intermediate which I upscaled with Instant HD, but I would like to save some time by avoiding this extra step.

Here is my workflow step by step:


Hope this helps! Also, it helps to limit the amount of camera movement and shoot at a higher shutter speed and use the amazing Reel Smart Motion Blur to put natural motion-blur back into the shot.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 09, 2013, 11:13:35 AM
Please, can you do again a comparison raw vs h.264 BUT with ML bitrate cranked up to maximum ? Or h.264 standard vs h.264 cranked to max with ML vs raw all in one test ! Nobody done this so far, so we can decide if raw is really Worth the work to assemble it ! Keep the comparison method you used in your previous test, also with the slanted stripe running across horizontally ! Many thanks !  ;)

Here is my comparison video (h264 default/raw) - (see video link) I will also attempt to create a video outlining what you requested to blazraidr. It may be nice to have 2 comparisons for consistencies sake.

https://vimeo.com/67975595 (https://vimeo.com/67975595)
https://www.youtube.com/watch?v=HNaxDW_oYy8 (https://www.youtube.com/watch?v=HNaxDW_oYy8)
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 09, 2013, 01:21:45 PM
Can someone explain what is the difference between 5x crop mode and normal recording? When I set a resolution without 5x crop engaged I get resolution which dont correctly relate to ratios. For instance, ratio is 16:9 and the resolution is 1216x416. And when I convert such footage it is stretched.
Title: Re: 550D raw video recording port official thread
Post by: CFP on June 09, 2013, 06:57:37 PM
I want to make some tests with Avisynth to find best way to remove aliasing, interpolate to 24fps, and upscaling to 1080p, but I've not a fast SD card right now.
I did the "interpolate to 24fps"-part already :D

- Avisynth script for doubling the framerate | Twixtor alternative (http://www.magiclantern.fm/forum/index.php?topic=6316.0)

I guess the upscaling can be done in Lightroom or ACR und aliasing can't be removed ... But if you have a better solution, please share it :)

Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 09, 2013, 06:59:56 PM
Is there a way to record audio while shooting raw?
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 09, 2013, 07:28:08 PM
Also sound is automatically disabled on this raw build is there a way to make it record sound when not in raw mode?  I have a big movie shoot today with over 500 people and I'm thinking of going to the stable Ml
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 09, 2013, 07:28:53 PM
Here is my workflow step by step:

  • 1. Import DNG Footage / Interpret at 12fps (or whatever your FPS was)
  • 2. Drag into a 16bit Comp and change Comp fps to 24p
  • 3. Apply Twixtor, set the Source Footage FPS to 12p
  • 4. Precomp that into it's own Comp
  • 5. Add Instant HD: ReSizer onto the new Precomped layer, set to fit to Comp
  • 6. Render to 10bit 444 DNxHD or Cinestyle

Hope this helps! Also, it helps to limit the amount of camera movement and shoot at a higher shutter speed and use the amazing Reel Smart Motion Blur to put natural motion-blur back into the shot.

the trees' movement looks twixtored to me. Unless the scene is almost steady, I think we will get better results by shooting at the speed we need, even if we have to upscale much more. Especially considering that Canon's compression messes around with the resolution as well (and we didn't know till now). We just need to optimise the upscaling process.

Is there a way to record audio while shooting raw?

Yes, check the Raw menu (I'm not sure if that's working on every build we have). It produces a wav file and can emit a beep for syncing purposes.

(Remember that fps override turns sound off!)

Can someone explain what is the difference between 5x crop mode and normal recording? When I set a resolution without 5x crop engaged I get resolution which dont correctly relate to ratios. For instance, ratio is 16:9 and the resolution is 1216x416. And when I convert such footage it is stretched.

5x crop mode gets only a portion of the sensor. So it's equivalent to having a much longer lens on. The other benefit is that the sensor sampling does not skip lines, so unlike other modes, you will get no aliasing.

If you are recording on Canon's 720P mode, the camera skips some more horizontal lines than vertical ones. You will have to stretch the image in post (550D is around 1.67). The benefit is that you can scan a bigger area of the sensor while keeping the data rate (closer to the vision angle of your lens). This will generate more aliasing, though.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 09, 2013, 08:47:32 PM
Yes this 5x and 10x references and 1:1 crop have been bugging me too. :-)

With the 550D raw builds in video mode 1920x1080, it appears there is no option to disable 5x and 10x, it's one or the other or am I looking in the wrong place?

I've tried disabling the multiplications before enabling raw video, after, before loading modules, after but non seem to disable the 5x and 10x zoom.

So where is the 1:1 crop no zoom? :-)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 09, 2013, 08:56:56 PM
5x is the 1:1 crop mode. Disabling 10x is under LiveView Zoom Tweaks menu
Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 10, 2013, 02:02:06 AM
hello!

i´m completely new to this forum. first of all: thank you all for that incredible software!
i did some testshots with my beloved 550D.

setup is in the video specs.

Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 10, 2013, 02:26:38 AM
hello!

i´m completely new to this forum. first of all: thank you all for that incredible software!
i did some testshots with my beloved 550D.

setup is in the video specs.

Very nice! What resolution and fps did you shoot at, and what pp workflow did you use? You've got a lot more detail in those shots than I have been able to get.
Title: Re: 550D raw video recording port official thread
Post by: dpiximaj on June 10, 2013, 06:29:25 AM
1280x432@22fps, ISO 160, Tamron 17-50@2.8 conformed to 23.976 in AE & uprez MB Instant HD(not instant) to 1920x648 w/frame blending. Instant HD scales nicely in the diagonals looks very nice - just ever so slightly softer, takes alot of cycles to render.

http://www.youtube.com/watch?v=9qAbkOhb3rU&feature=youtu.be
Title: Re: 550D raw video recording port official thread
Post by: JoshuOne on June 10, 2013, 12:28:58 PM
this is from the 500D, I hope you all dont mind me putting it in this forum. I shot it at 12fps to gain higher resolution in camera. Thanks again mk11174 for the bin with Modules, btw can anyone tell me if the Auto ETTR is a module or if I would have to plead for a bin with it enabled for the 500d? Thanks for your time.
Title: Re: 550D raw video recording port official thread
Post by: funkysensation on June 10, 2013, 01:09:11 PM
Hey guys here are two tests of the ML Raw Module:

from last week in Istanbul 960x480@24fps upscaled to 720p (ML_960x480_Raw_Rec from mk11174). Please download the HD Version (vimeo hd limit is reached)

and from Rhein in Duesseldorf 1280x426@24fps (latest built) got 240 frames continuously.
Thank you guys for your excellent work on 550D.


Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 10, 2013, 01:36:15 PM


Very nice! What resolution and fps did you shoot at, and what pp workflow did you use? You've got a lot more detail in those shots than I have been able to get.


Shot entirely in 1152 x 432 @ 23,976 fps 14 bit  (RGB) RAW
Transcend 32 GB Class 10 (mem hack enabled)
shown bitrate whilst recording: up to 19,5 MB/s after a few seconds "warm up"

Flow:
- rawanizer=> dng
- canon raw software => tiff ( "grading" done completely in raw then exported as 12 bit tiffs)
- Quicktime => dnxhd 10bit
- editing/scaling in lightworks

this is a very slow workflow. i chose it because it gave me the most speed in developing the RAWs (since i´m used to photo raw since years) and maintained the image quality through the rest of the process. no furthermore color adjustments happened in the editing process.

i´m still waiting for a workflow to generate DNGs, that can be imported straight into resolve and treat the files as native camera raw.  can´t resolve do 14 bit DNGs? it just opens the preview jpegs....


in the future a special ML RAW camera specific LUT (picture profile to address CA and maybe aliasing) for recording and a resolve specific RAW setting (debayering and optimized color matrix) would be the absolute killer-killer icing on the cake feature.

lenses used:
- canon 28 mm  f 2.8
- canon 18-55 mm f 3.5-5.6
- canon 50 mm f 1.8
+ ND 4  Filter (Cokin)

i always used an aperture above f 5 an below f 14 to achieve the best possible sharpness and mostly exposed for the highlights. exposing the highlights till they´re not overexposed and then adding one f-stop more turned out to be always recoverable while developing. sometimes even more.
shadows and blacks are pushed till a nearly flat image is achieved. then fine tune with curves to get contrast and adjust gamma. here and there some color tweaks, minor sharpening, noise reduction.
activate CA reduction and edge defringing. no further lens corrections. there should be no lens distortion or vignetting since the huge crop factor.

but there are some limitations:
you can´t go to the maximums when pushing or squeezing luminance or contrast color channel wise. ( in ACR this is the place where you can read such things as "aquas" or "magentas" )
when using extreme settings you´ll get ugly noise. not visible in a still, but very noticeable in moving image sequences.

in my opinion color resolution always beats pixel resolution. sharpening and scaling algorithms benefit so much from the added image information. also the much better motion resolution is incredible (the reason why twixtor or nukes kronos can achieve much better interpolated images)

i hope, this information is sufficient for now  :)

and i hope some skilled people are able to address the memory controllers limitations physically. maybe a way to replace it with a faster one or to convert the data lines into IDE or even SATA.... well.....i´m just dreaming   ;D
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 10, 2013, 01:56:16 PM
Do someone knows about a workflow where we use a resolution/fps pair that provoke some dropped frames, then, in post production, an automatic method finds the dropped frames and interpolates them by feeding twixtor ? It would be very nice and useful !  8)
Title: Re: 550D raw video recording port official thread
Post by: dpiximaj on June 10, 2013, 04:31:20 PM
crash-film great info - thanks
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 10, 2013, 07:58:50 PM

- rawanizer=> dng
- canon raw software => tiff ( "grading" done completely in raw then exported as 12 bit tiffs)
- Quicktime => dnxhd 10bit
- editing/scaling in lightworks
Thanks!

What canon raw software do you use? I am unable to open the dng's in DPP.
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 10, 2013, 10:24:09 PM
An Other test, this time I used the 1152x432 resolution at 24fps

Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 10, 2013, 11:22:38 PM
An Other test, this time I used the 1152x432 resolution at 24fps



Really nice shots. Would you mind sharing your workflow?

Thanks
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 10, 2013, 11:28:10 PM
Hey guys here are two tests of the ML Raw Module:

from last week in Istanbul 960x480@24fps upscaled to 720p (ML_960x480_Raw_Rec from mk11174). Please download the HD Version (vimeo hd limit is reached)

and from Rhein in Duesseldorf 1280x426@24fps (latest built) got 240 frames continuously.
Thank you guys for your excellent work on 550D.

Wow 1280x426@24fps (latest built) got 240 frames continuously!

What sd card do you have, if I may ask?
Title: Re: 550D raw video recording port official thread
Post by: robinson brothers on June 11, 2013, 02:24:05 AM

RainDrops
 Magic Lantern RAW Test

Camera: 500D (T2i)
 Canon 50mm 1.8, Zoom Lens 75-300mm and 18-55mm
 RAW Resolution: 1152x496 20fps
 Output Resolution: 1920x800 24fps

Workflow: RAWanizer > ACR > AfterEffects (Upsizing, Output to Cineform) > Premiere (Editing) > SpeedGrade (ColorGrade, Output DPX) > Premiere (Output MP4 and others)

Music: RainDrops (Working piece by Jonathan Robinson (Me)
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 11, 2013, 10:47:08 AM
is there any new build for 550d?and what about the shoot malloc...the buffer seems to be larger than 2+31mb

any chance to unlock this?

thanks for this great raw tool!!
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 11, 2013, 11:48:32 AM
here i found someting interresting it seems there is a little bit more speed possible...

http://www.traumflieger.de/desktop/kameras/testverfahren/kartentest.php
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 11, 2013, 12:54:28 PM
here i found someting interresting it seems there is a little bit more speed possible...

http://www.traumflieger.de/desktop/kameras/testverfahren/kartentest.php

 This is indeed interesting. So the fastest card for our 550D would be Sandisk Extreme 16GB 30MB/s. It squeezes out 22,6 MB/s!
Title: Re: 550D raw video recording port official thread
Post by: FailedRenegade on June 11, 2013, 05:22:42 PM
This is indeed interesting. So the fastest card for our 550D would be Sandisk Extreme 16GB 30MB/s. It squeezes out 22,6 MB/s!
I ran some test on my 550D with with a 32GB Sandisk Extreme 30MB/s card. Images from the tests are here if you are interested https://picasaweb.google.com/114928490933466628908/MagicLanternTests
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 11, 2013, 05:27:44 PM
thanks a little bit faster than my lexar
Title: Re: 550D raw video recording port official thread
Post by: dpiximaj on June 11, 2013, 07:14:14 PM
Tried both 30mb & 45 mb ExtremePro cards and 45 gave me more frames and fps.  I've landed on 3:1 1280x426 @ 23fps, after maybe one drop frame record, it'll give me 3000+ on the 45MB... fyi  Magic Raw record module...
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 11, 2013, 07:40:08 PM
Tried both 30mb & 45 mb ExtremePro cards and 45 gave me more frames and fps.  I've landed on 3:1 1280x426 @ 23fps, after maybe one drop frame record, it'll give me 3000+ on the 45MB... fyi  Magic Raw record module...

those are great numbers!

Wow the 550D is a real raw camera!
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 11, 2013, 07:55:07 PM
sandisk extreme 45MB/s test
http://hepsicekiyor.wordpress.com/2013/05/12/sandisk-extreme-45mbs-hafiza-karti-inceleme/

sandisk extreme 30MB/s test
http://hepsicekiyor.wordpress.com/2013/05/26/sandisk-extreme-30mbs-hafiza-karti-testi/

on kingston usb 3.0 card reader
Title: Re: 550D raw video recording port official thread
Post by: funkysensation on June 11, 2013, 08:13:06 PM
@notdabod
i used a sandisk extreme pro 95 mb/s 32gb to get 240 Frames at 1280x426...
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 11, 2013, 09:57:19 PM
Got a strange issue going on. This is what I get when I convert my RAW file to DNG's. They look like this;

(http://i.imgur.com/vt4DZwDl.jpg)

I've tried formatting the card, removing magic lantern from both the camera and the card, re-installing it, and different builds. I'm using a Scandisk Extreme 45mb/s card, too.

Any ideas?  :-\
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 11, 2013, 10:28:12 PM
Got a strange issue going on. This is what I get when I convert my RAW file to DNG's. They look like this;

(http://i.imgur.com/vt4DZwDl.jpg)

I've tried formatting the card, removing magic lantern from both the camera and the card, re-installing it, and different builds. I'm using a Scandisk Extreme 45mb/s card, too.

Any ideas?  :-\

first of all, its sandisk.

second, try adjusting framerates. you're using 24p or 30p.
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 11, 2013, 10:32:57 PM
first of all, its sandisk.

second, try adjusting framerates. you're using 24p or 30p.

Ah, my bad.

It worked for a bit last night recording 24p @ 960x480 with a 2:1 aspect ratio.
I've just tried it at 22fps and nothing, same problem. Everything I try results in those weird artifacts/corruptions.

EDIT: Just tried 12fps and it seems to have worked, apart from a slight glitch on one frame. I don't get why it'd be glitching if my settings were below 20mb/s write?
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 11, 2013, 11:41:33 PM
Ah, my bad.

It worked for a bit last night recording 24p @ 960x480 with a 2:1 aspect ratio.
I've just tried it at 22fps and nothing, same problem. Everything I try results in those weird artifacts/corruptions.

EDIT: Just tried 12fps and it seems to have worked, apart from a slight glitch on one frame. I don't get why it'd be glitching if my settings were below 20mb/s write?

I had 2 550Ds (now have one) always used different versions of them with same SD cards (sandisk extreme series, 30MB/s and 45MB/s) never get what you've experiencing. maybe someone else can answer your request.
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 12, 2013, 12:28:08 AM
I had 2 550Ds (now have one) always used different versions of them with same SD cards (sandisk extreme series, 30MB/s and 45MB/s) never get what you've experiencing. maybe someone else can answer your request.

Which build are you guys using? I don't seem to be able to get as high a res, or aspect ratio as most people here, despite having a fairly decent card?
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 12, 2013, 12:32:35 AM
Which build are you guys using? I don't seem to be able to get as high a res, or aspect ratio as most people here, despite having a fairly decent card?

maybe your card is not real sandisk extreme, there are some kirfs on the market. have you checked the speed with usb 3.0 card reader (if you have)

I'm using what they're using, nothing special. I don't do modifications lately. you can find the zip file on 20th or 21st page
Title: Re: 550D raw video recording port official thread
Post by: ble55ed on June 12, 2013, 12:46:09 AM
Since the Hardware is locked at 21MB/s and I have two card which benchmark faster It won't matter correct because at the end of the day can't go higher.

My test looks like this:

Write speed buffer 2048 = 19.4MB/S
Read speed buffer 2048= 21.3 MB/S
Write speed buffer 1953= 16.7 MB/S
Read speed buffer 1953 = 21.0 MB/S
Write speed buffer 3072 = 19.5 MB/S
Read speed buffer 3072 = 21.4 MB/S
Write speed buffer 2929 = 17.9 MB/S
Read speed buffer 2929 = 21.1 MB/S
Write speed buffer 4096 = 19.5 MB/S
Read speed buffer 4096= 21.3 MB/S


I'm getting the bug where the screen is all messed up but i'm using FPS override at 12 fps @ Resolution 1280x640

Any ideas?
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 12, 2013, 10:43:38 AM
maybe your card is not real sandisk extreme, there are some kirfs on the market. have you checked the speed with usb 3.0 card reader (if you have)

I'm using what they're using, nothing special. I don't do modifications lately. you can find the zip file on 20th or 21st page

I think it is, I bought it in store rather than online. I'll run some tests on it later though to see!

Do people have any tips/advice? I've been reading about people having photo 'M' mode set to jpeg, rather than RAW - does that make a difference? Also, does it matter if the camera is in 1080p or 720p? I'm using FPS override to set it to 23.976 anyway
Title: Re: 550D raw video recording port official thread
Post by: ble55ed on June 12, 2013, 04:00:34 PM
I think it is, I bought it in store rather than online. I'll run some tests on it later though to see!

Do people have any tips/advice? I've been reading about people having photo 'M' mode set to jpeg, rather than RAW - does that make a difference? Also, does it matter if the camera is in 1080p or 720p? I'm using FPS override to set it to 23.976 anyway

I'm having the same issue as you with the last build. I'm going to revert back a few builds to where I know it was working.
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 12, 2013, 04:33:24 PM
There is no hope to overcome that bottleneck? I´m pretty happy recording raw 1280x426 for 197 frames in fact, while waiting for my BMPCC, but time is going soooo slow :)
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 12, 2013, 09:11:05 PM
So I'm feeling a little stupid here. I'm trying to understand this whole process.
1. Get another sdhc card (sandisk extream 16 gig).
2. Copy .bin developed by MK11174 (thank you) onto memory card.
3. Copy modues by MK11174 (thank you again) into folder within .bin???
4. Shoot RAW footage
 Workflow
1. Copy raw files from memory card onto hard drive (what raw file format is this)?
2. import RAW footage into RAWanizer and export as MP4??
3. Use Lightroom to color grade?
4. I use Power Director, so would edit with this.
I'm probably not right about this, so if someone can straighten me out.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 12, 2013, 09:44:41 PM
Hey guys, since I know most of you in here by now, Ill just share this link to this Tutorial I made for anyone interested in compiling themselves, good for beginners that just cant get it going. For windows only though, teaches you how to get going using virtualbox. Hope it comes in handy for someone.  :D

http://www.magiclantern.fm/forum/index.php?topic=6425.msg50213#msg50213
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 12, 2013, 11:37:33 PM
Thanks for the info mk11174.

I saw you mention the devs in that link. I havent seen any of them post for a while.

I have a little programming experience but by the time I catch up to speed with this, I am sure that someone will have already programmed what needed to be programmed at that point. Wish I could assist them!

Anyway, thanks again!
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 13, 2013, 08:26:53 AM
@mk11174, Thanks for the guide! Going to try it soon
Title: Re: 550D raw video recording port official thread
Post by: otherman on June 13, 2013, 08:47:27 AM
I've an idea to improve raw recording with "only sd" cameras, but I don't know if it's possible: what about recording on SD, AND on usb (with pc, or android tablet)? one frame on sd, the next to usb, an so on.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 13, 2013, 10:06:45 AM
even if it was possible, the workflow would get even more complicated...
Title: Re: 550D raw video recording port official thread
Post by: otherman on June 13, 2013, 10:27:27 AM
There are people thinking on change SD module soldering a new one: this is a too complicated workflow!
You have yet to pass a raw file with raw2dng or similar; whit my idea, the files to process are two. It'll be an option, standard recording to SD only, enhanced recording for SD&USB.
ML is all about "more choices, the better!" yet!

(Sorry for my english, again)
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 13, 2013, 10:49:48 AM
sorry, wrong page.
Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 13, 2013, 01:31:21 PM
hi everyone,

here´s some low and shallow light testing. half of the material was deleted by a mistake and i had just a photo ball head tripod...
yeah.... and it´s a little bit trippy  8)

workflow this time@work:
ACR=>AE (resizer to 1080p)=>dnxhd 10bit=>Media Composer

Title: Re: 550D raw video recording port official thread
Post by: tackyattack on June 13, 2013, 02:52:27 PM
hi everyone,

here´s some low and shallow light testing. half of the material was deleted by a mistake and i had just a photo ball head tripod...
yeah.... and it´s a little bit trippy  8)

workflow this time@work:
ACR=>AE (resizer to 1080p)=>dnxhd 10bit=>Media Composer


That was absolutely stunning!!! It's nice to finally see something that isn't just cats, dogs, flowers, cars, or telephone poles! This really illustrates how much RAW can help. Care to share what settings you used on the cam?
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 13, 2013, 08:40:20 PM
@notdabod
i used a sandisk extreme pro 95 mb/s 32gb to get 240 Frames at 1280x426...

thanks for the post.

sandisk extreme is 45 mb/s
sandisk extreme PRO is 95 mb/s


I'm wondering how big a difference a sandisk extreme vs extreme pro would make?

anyone done any tests?

It's just that costco has a sale on extreme's not extreme pro's.

thanks

Title: Re: 550D raw video recording port official thread
Post by: qsara on June 13, 2013, 08:53:24 PM
thanks for the post.

sandisk extreme is 45 mb/s
sandisk extreme PRO is 95 mb/s


I'm wondering how big a difference a sandisk extreme vs extreme pro would make?

anyone done any tests?

It's just that costco has a sale on extreme's not extreme pro's.

thanks

it doesn't matter if you use ducati editions* on 550D, it can handle only 20MB/s data output to the SD card, I'm using both Sandisk extreme 20MB/s & 30MB/s (old series) and new Sandisk extreme 45MB/s there is no difference on bitrate increase / decrease.

here is the test of Sandisk extreme 30 and 45MB/s at USB 3.0 card reader on my site.

http://hepsicekiyor.wordpress.com/2013/05/26/sandisk-extreme-30mbs-hafiza-karti-testi/

http://hepsicekiyor.wordpress.com/2013/05/12/sandisk-extreme-45mbs-hafiza-karti-inceleme/

*they are old, but if they were new, I know they can kick 120MB/s today.
Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 13, 2013, 10:12:31 PM
That was absolutely stunning!!! It's nice to finally see something that isn't just cats, dogs, flowers, cars, or telephone poles! This really illustrates how much RAW can help. Care to share what settings you used on the cam?


thx!!!

the settings where:
tragic lantern raw module, mem hack on, 1152x432 @ 23,9 fps, transcend class 10 32 GB,  1920x1080 24 fps video mode, no 5x zoom (it always stops after 70 frames in zoom mode)
tested several cards. even a lexxar 400x can´t do more resolution....

and the best settings of all..... in a few days the nearly new 50d arrives. so i gave up extensive testings on the settings and concentrated on the images  ;D

and a message to the developers:
thanks again. just a few days before the raw "hack" got public i explained to a friend of mine why it´s just a merketing thing, that you can´t buy a camera for € 3000 that records 2k raw. now nobody can say anymore, it´s impossible for that money.
and THIS is, what truly matters!!

Title: Re: 550D raw video recording port official thread
Post by: ljubex on June 13, 2013, 10:43:45 PM
Hi everyone,

I've made a small test of ML RAW video on 550d. It was recorded in 1024x352 at 24 fps. Didn't do the upscale to 720p. Generally, I'm impressed with increase in dynamic range and sharpness over h.264, but the workflow and low resolutions are big issues. Workflow was raw2dng>After Effects>Premiere Pro.

Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 14, 2013, 01:27:19 AM
Can I get a link to you bin file MK11174 please.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on June 14, 2013, 03:41:32 AM
ljubex, that looked really nice. I think that we 550D owners have to accept that, for us, RAW is all about better color and less compression noise. If you can live with that it's great. But we can't have everything.

I love some of the color you got in those street shots and the water looked quite crisp and sharp. It is just a shame that we can't squeeze anymore bit rate for more resolution.

But the colors are amazing aren't they!?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 14, 2013, 05:23:45 AM
Can I get a link to you bin file MK11174 please.
Should all be on the 1st page of this thread
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 14, 2013, 10:45:11 AM
I guess anamorphic lens is the only way we could get more resolution with 550d?
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 14, 2013, 11:47:06 AM
the settings where:
tragic lantern raw module, mem hack on, 1152x432 @ 23,9 fps, transcend class 10 32 GB,  1920x1080 24 fps video mode, no 5x zoom (it always stops after 70 frames in zoom mode)

Sorry for my naivety, but could you explain how you got the memory hack on the tragic build? Also, is the 'no 5X times' just disabling the 5X from when the zoom button is pressed to check focusing?

Footage looks great though, the water looks so good!
Title: Re: 550D raw video recording port official thread
Post by: internetjoke on June 14, 2013, 07:59:26 PM
I just want to say at first i was a bit disheartened by the limit on the 550d. I have really been considering selling up and getting a 50d but looking at the recent updates (tragic lantern) I actually feel that the 550d possesses a cinematic feel that the cf cards models do not have.

I actually prefer the quality of the 550d over the 50d

Some of these example videos on here now almost look like technicolour from the 1950s!
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 15, 2013, 02:10:10 AM
Ok Guys

I've shot some raw footage at 1152x656 @ 29.97. I have used raw2dng to get the dng files. I imported those files tp After Effects, made some minor changes, then saved as a premier pro project file.

Then I opened Premier, imported the project, then rendered the file out. When I look at the resulting video it just looks like a still and not video.

What am I missing here.

Any help would be greatly appreciated.
Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 15, 2013, 03:55:41 AM
Hey guys, since I know most of you in here by now, Ill just share this link to this Tutorial I made for anyone interested in compiling themselves, good for beginners that just cant get it going. For windows only though, teaches you how to get going using virtualbox. Hope it comes in handy for someone.  :D

http://www.magiclantern.fm/forum/index.php?topic=6425.msg50213#msg50213

strange.. i downloaded the pre-build VMbox ML .zip
the MagicLantern.vdi zip was corrupted.
virtualBox wont able to boot in to linux.
ive downloaded 6times for now, tried DAP, downloadHelper firefox and firefox default downloading.

anyone success opening it?
btw im using winrar and win7 default unzip. on 64bit system.
Title: Re: 550D raw video recording port official thread
Post by: Audionut on June 15, 2013, 05:44:48 AM
I actually prefer the quality of the 550d over the 50d

Raw is raw.  How people grade and encode their footage are 2 totally different things that aren't affected by the raw output of different cameras (resolution limits excluded).
Title: Re: 550D raw video recording port official thread
Post by: Audionut on June 15, 2013, 05:46:32 AM
strange.. i downloaded the pre-build VMbox ML .zip
the MagicLantern.vdi zip was corrupted.

IIRC, there is a md5sum included in the download to check integrity.
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 15, 2013, 07:27:49 AM
it doesn't matter if you use ducati editions* on 550D, it can handle only 20MB/s data output to the SD card, I'm using both Sandisk extreme 20MB/s & 30MB/s (old series) and new Sandisk extreme 45MB/s there is no difference on bitrate increase / decrease.

here is the test of Sandisk extreme 30 and 45MB/s at USB 3.0 card reader on my site.

http://hepsicekiyor.wordpress.com/2013/05/26/sandisk-extreme-30mbs-hafiza-karti-testi/

http://hepsicekiyor.wordpress.com/2013/05/12/sandisk-extreme-45mbs-hafiza-karti-inceleme/

*they are old, but if they were new, I know they can kick 120MB/s today.

Yeah I got a sandisk extreme 45 mb/s card and it's the same as my kingston class 10 card. Back it goes to costco.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 15, 2013, 09:20:16 AM
Yeah I got a sandisk extreme 45 mb/s card and it's the same as my kingston class 10 card. Back it goes to costco.
I've got the same experience from my sandisk extreme 45 mb/s: i was disappointed, because it acts just slightly better then almost any other class 10 sd card, but then i got the sandisk extreme pro 95 mb/s, and now i'm easily getting stable 1152x464 for more than 600 frames at 23.976 fps.
It is just a strange “piece of luck” that sd controller bottleneck and write speed of 10 class sd cards are just about the same.
So you need a really fast card to be sure you hit the right one.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 15, 2013, 09:47:11 AM
Yeah I got a sandisk extreme 45 mb/s card and it's the same as my kingston class 10 card. Back it goes to costco.

this is just funny you blame sandisk because of your slow cameras. I'm using 45MB/s card on EOS M, and 30MB/S on 550D without any problems.

here are other CLASS 10 cards, you can see the results!

they are not the same with sandisk extreme 45MB/s, even 30MB/s

toshiba class 10, white card, made in japan
http://hepsicekiyor.wordpress.com/2013/05/13/toshiba-class-10-16gb-made-in-japan-hiz-testi/

sandisk ultra class 10, 30MB/s edition (which really sucks)
http://hepsicekiyor.wordpress.com/2013/05/13/sandisk-ultra-class-10-16gb-30mbs-testi/

transcend class 10, which surprised me a bit
http://hepsicekiyor.wordpress.com/2013/05/13/transcend-class-10-8gb-hafiza-karti-testi/

sandisk extreme cards has their own unique controllers and advanced write mechanisims, even sandisk usb drives uses trim option now.
Title: Re: 550D raw video recording port official thread
Post by: ble55ed on June 15, 2013, 06:05:45 PM
Quick question... If I use FPS override I get the messed up colors instead of an image no matter how low I go with the FPS override. I turn the FPS override and I run this thing at full 24p at the same resolutions people have been lowering their FPS's to get without any frames dropping. I want to go higher but when I use the FPS override to help this is where I get the error
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 16, 2013, 05:40:16 AM
Ok Guys

I've shot some raw footage at 1152x656 @ 29.97. I have used raw2dng to get the dng files. I imported those files tp After Effects, made some minor changes, then saved as a premier pro project file.

Then I opened Premier, imported the project, then rendered the file out. When I look at the resulting video it just looks like a still and not video.

What am I missing here.

Any help would be greatly appreciated.

Because you already rendered it out, the only thing I can fathom is that the file has a huge bit rate and your computer can't handle it. In other words, it's "trying" to play the video but it's stuck on one frame. The funny thing I have noticed (and I now I can't remember if I downloaded a codec) is that I have the best luck playing the video with Windows Media Player of all things (if rendered out as a mov). Other than that....I have no idea! haha
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 17, 2013, 04:54:13 AM
Double post
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 17, 2013, 05:54:22 AM
I've got the same experience from my sandisk extreme 45 mb/s: i was disappointed, because it acts just slightly better then almost any other class 10 sd card, but then i got the sandisk extreme pro 95 mb/s, and now i'm easily getting stable 1152x464 for more than 600 frames at 23.976 fps.
It is just a strange “piece of luck” that sd controller bottleneck and write speed of 10 class sd cards are just about the same.
So you need a really fast card to be sure you hit the right one.

Thanks for this, great numbers.

I get about 87 frames with 1280 at 3:1, 24fps with the sandisk extreme 45 mb/s and Kingston class10.

http://www.komputerbay.com/products.php?prodid=124000

Anyone used this card? All the 5dm3 talk about komputerbay cards.

Title: Re: 550D raw video recording port official thread
Post by: ilguercio on June 17, 2013, 08:06:23 AM
Your 550D can only write 20ishMB/sec to the card so no matter how good your card is the SD card controller won't be fast enough to use the card up to its full potential.
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 17, 2013, 02:16:05 PM
Are the latest builds the ones on the first page of this thread? Which one do people seem to be having the most luck with?
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 17, 2013, 03:55:36 PM
I'm running into an issue with raw2dng. It seems to work fine on a raw file 61 meg in size but when my raw file id 528 meg it does not work. Has anyone else experienced this??
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 17, 2013, 07:19:02 PM
Are the latest builds the ones on the first page of this thread? Which one do people seem to be having the most luck with?

[1] Yes
[2] The last... obvious !  ;-)
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 17, 2013, 07:24:34 PM
[1] Yes
[2] The last... obvious !  ;-)

haha, thanks man!

So this one?
Quote
Another build with the help of Xaint getting us a bit more memory for recording, I am getting much more frames before skipping now with 1280x432x24p 193 frames to be exact, was only getting 86 before his hack.

This also includes Alex's latest bitbuckit update, gives us more resolution choices looks like and a mem hack but doesnt seem to help our cam at all.

http://www.mediafire.com/download/09bl5v3ovzca5c7/ML_Raw_MemFix.zip

This includes Filemanager as will, you can find in the Debug menu.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 17, 2013, 07:34:31 PM
haha, thanks man!

So this one?

Exactly  ! Then, download the modules (the very next download, just right under it) and follow instructions, so you can choose what build works better for your purpose (the "tragic lantern" or the "magic lantern" one)  8)
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 17, 2013, 09:58:42 PM
Exactly  ! Then, download the modules (the very next download, just right under it) and follow instructions, so you can choose what build works better for your purpose (the "tragic lantern" or the "magic lantern" one)  8)

That's awesome, thanks a lot buddy!  ;D
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 17, 2013, 11:28:00 PM
Thanks for this, great numbers.

I get about 87 frames with 1280 at 3:1, 24fps with the sandisk extreme 45 mb/s and Kingston class10.

http://www.komputerbay.com/products.php?prodid=124000

Anyone used this card? All the 5dm3 talk about komputerbay cards.

Get the latest build, I was only available to get 87 frames but with the last one I´m getting 197 frames 1280 3:1 resolution  ;)
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 18, 2013, 01:51:15 AM
Get the latest build, I was only available to get 87 frames but with the last one I´m getting 197 frames 1280 3:1 resolution  ;)

http://www.mediafire.com/download/09bl5v3ovzca5c7/ML_Raw_MemFix.zip

If this is the lastest then I'm using it.
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 18, 2013, 09:31:36 AM
I've got the same experience from my sandisk extreme 45 mb/s: i was disappointed, because it acts just slightly better then almost any other class 10 sd card, but then i got the sandisk extreme pro 95 mb/s, and now i'm easily getting stable 1152x464 for more than 600 frames at 23.976 fps.
It is just a strange “piece of luck” that sd controller bottleneck and write speed of 10 class sd cards are just about the same.
So you need a really fast card to be sure you hit the right one.

I get 80 frames at 1152x460 with 23.976 fps with my Kingston sd card which is the same speed as the sandisk 45 mb/s.

You are getting like tens times the frames I am with the extreme pro.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 18, 2013, 11:15:06 AM
Hey guys, sorry, I should of added this update a week ago, but this one is up to date even more, but the main thing is the ability to save RAW settings after restart.

Includes Magic and Tragic as well and Mem fix

http://www.mediafire.com/download/ucu66qgfuqr8wzq/ML_550D_June_18_2013_Updates.zip (http://www.mediafire.com/download/dj6td3fbetp6nbd/ML_550D_June_18_2013_Update.zip)
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 18, 2013, 11:46:32 AM
Hey guys, sorry, I should of added this update a week ago, but this one is up to date even more, but the main thing is the ability to save RAW settings after restart.

Includes Magic and Tragic as well and Mem fix

http://www.mediafire.com/download/ucu66qgfuqr8wzq/ML_550D_June_18_2013_Updates.zip (http://www.mediafire.com/download/dj6td3fbetp6nbd/ML_550D_June_18_2013_Update.zip)

Now I´m able to get 240 frames 3:1 1280x426 with magic raw, thanks mk11174!!! 
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 18, 2013, 01:21:29 PM
Now I´m able to get 240 frames 3:1 1280x426 with magic raw, thanks mk11174!!! 
Previous build gives me 300+ frames 1280x426 in photo mode at 23.976 fps (sandisk 95 mbps).
For me, this last update works slightly worse then previous. For example, i had 900+ frames 1152x460, but now its only about 600. And the previous one worked nicely in photo mode, giving me better results. The last one have some problems with photo mode.
The one great thing is the ability to save settings of the raw-rec modules for sure.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 18, 2013, 01:46:14 PM
this one is up to date even more

Top post updated ! Thanks !  8)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 18, 2013, 02:12:35 PM
If you run the speed simulation script (https://bitbucket.org/hudson/magic-lantern/src/tip/modules/raw_rec/speedsim.py), you would notice that at 1152x460 you get 603 frames if the card write speed is 20.9 MB/s and 891 if the speed is 21.0. For reproducing the results: buffers 32x2+8, 23.976 fps, timing variation 0.

So these reports about slowdown are quite pointless.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 18, 2013, 02:45:34 PM
If you run the speed simulation script (https://bitbucket.org/hudson/magic-lantern/src/tip/modules/raw_rec/speedsim.py), you would notice that at 1152x460 you get 603 frames if the card write speed is 20.9 MB/s and 891 if the speed is 21.0. For reproducing the results: buffers 32x2+8, 23.976 fps, timing variation 0.

So these reports about slowdown are quite pointless.
I'm using the same card for every test (sandisk extreme pro 95 mbps 8gb) and with the latest build i get around 580 frames with 1152x460 at 23.976 fps, but with previous at least 900 and sometimes 1300. These results are consistent, not random. (magic raw)

Results for tragic raw:
with the previous build i have at least 386 frames at 1152x464
Now with these parameters recording stops everytime after 68 frames.

So obviously something is going on besides the card write speed etc.
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 18, 2013, 02:49:51 PM
So you have noticed a consistent slowdown of 0.1 MB/s? I don't think this is enough to jump to the conclusion that the latest build is any slower.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 18, 2013, 02:59:49 PM
So you have noticed a consistent slowdown of 0.1 MB/s? I don't think this is enough to jump to the conclusion that the latest build is any slower.
Well, for me 68 frames vs 386 is significant slow down indeed. In terms of real usability, but not the inner figures and values. Just facts for my setup (camera/card), no offence intended.
Title: Re: 550D raw video recording port official thread
Post by: funkysensation on June 18, 2013, 03:37:32 PM
Here is another Test video i did last Weekend in Copenhagen Denmark.


http://550draw.blogspot.de/ (http://550draw.blogspot.de/)
Title: Re: 550D raw video recording port official thread
Post by: Ivoprod on June 18, 2013, 05:05:58 PM
Here is another Test video i did last Weekend in Copenhagen Denmark.


http://550draw.blogspot.de/ (http://550draw.blogspot.de/)

Which build you use?
And What SD card ?
Also Interesting , moire is in very usable range, which lens you use?
Title: Re: 550D raw video recording port official thread
Post by: funkysensation on June 18, 2013, 05:35:13 PM
I´m impressed too that moire is not that much visible. Try to shoot stuff like the shot at 01:45 you will get crazy with the intern H264. 
Lenses:
Zenitar Fisheye  16mm f2.8
Sigma 28-300mm

latest built I think
ML_RAW_MEM_FIX 

Sandisk Extreme Pro 95MB/s 32GB
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 18, 2013, 06:08:24 PM
I've added a small buffer optimization to the raw rec simulator:

https://bitbucket.org/hudson/magic-lantern/commits/0db037b3b960

With the numbers from the example above:

1152x460 23.976fps 20.0MB/s => with current ML method, the simulation says 198 frames.
After optimization (only reordering and splitting the buffers differently) => 880 frames;

At 21.0 MB/s => 729 frames with current method, 2880 optimized.

Notice there's a slight difference from the previous numbers, because the latest script also models the slight speed loss from using small buffers.

Can you implement this buffering strategy in raw_rec and check if my theory is valid?
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 18, 2013, 06:49:10 PM
Here is another Test video i did last Weekend in Copenhagen Denmark.


http://550draw.blogspot.de/ (http://550draw.blogspot.de/)

Very nice quality, congratz
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 18, 2013, 09:36:55 PM
Here is another Test video i did last Weekend in Copenhagen Denmark.
http://vimeo.com/68607691

http://550draw.blogspot.de/ (http://550draw.blogspot.de/)
Nice! How do you avoid temporal aliasing in small details like leaves and roof tiles?

I got some footage of skerries covered with dried lichen (tiny details) which shows bad noise from temporal aliasing (I assume) in bright areas, which is driving me crazy trying to correct.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 18, 2013, 11:44:03 PM
This is the patch I am using in both Magic and Tragic module, nothing has changed since the first time we found out about the mem fix.
Code: [Select]
     /* try to recycle the waste */

-    if (waste >= 16*1024*1024 + 8192)

+    if (waste >= 8*1024*1024 + 8192)

     {

         buffers[buffer_count].ptr = (void*)(((intptr_t)(fullsize_buffers[0] + buf_size) + 4095) & ~4095);

         buffers[buffer_count].size = waste - 8192;

@@ -625,6 +625,17 @@
         buffer_count++;

         total += waste;

     }

+

+/* Sort Buffers */

+    static struct buff temp[10];

+    for (int i = 0; i < buffer_count; i++)

+ for(int j = 0; j < buffer_count- i - 1; j++)

+ if(buffers[j].size > buffers[j + 1].size) // > kisbuffer elöl

+            {

+                temp[j] = buffers[j];

+                buffers[j] = buffers[j + 1];

+                buffers[j + 1] = temp[j];

+            }

Tragic version is not from the main repo, that is from his own repo. So maybe something differ in the code that makes it work differ. Not sure.

I just use Magic version and it has not let me down yet, very happy with how it works considering our controller limitation, sometimes I get good frames, sometimes bad, I think it depends on the card condition at the time, seems to random to say it is in the code that causes it.

Maybe if you try without loading other modules to see if that makes a differ in performance, in this version I added the picview module too.

Go to the module menu and go to each module except Raw_Rec and press set on each and choose not to autoload them, then set the main autoload to on and restart camera so it only loads raw_rec.
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 19, 2013, 05:04:13 AM
A1ex, if that patch works you'll have to tell us where to build you a statue.

In another order of things, would it be possible to keep the 10x crop for focusing purposes and avoid the camera crash? Something like ML turns Raw off the moment you go 10x and then turns it on when you're back to normal or 5x.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 05:41:04 AM
not exactly sure if or what I should change unless the mem patch I mentioned in last post is already the best method which is the one we have been using.

Or am I suppose to change something else to try Alex's find?

I would be glad to test it if I knew what to change.

Do you simply want me to change if (waste >= 8*1024*1024 + 8192)  to if (waste >= 2 + 8*1024*1024)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 11:47:29 AM
This version seems to run good for me, things I do with this one that helps is.
Turn Global Draw Off
Use FPS to set fps to 23.976 but 23 seems like it will go on forever
I was testing 1152x460
I use Canon Preview mode
And I used Magic Raw

But first try it with your normal settings you are use to and see if this version does better or worse.

If first record does not do good, try again and see how good next record does.

http://www.mediafire.com/download/25py137awp0s7x9/ML_550D_June_19_2013_Update.zip (http://www.mediafire.com/download/25py137awp0s7x9/ML_550D_June_19_2013_Update.zip)

UPDATE: After more tests I found this one was no better and recorded corrupted frames.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 19, 2013, 12:10:25 PM
These two last records doesn't work in photo mode.
But previous one was able to get as much as twice more frames compared to movie mode. What is the reason for that?
Title: Re: 550D raw video recording port official thread
Post by: marekk on June 19, 2013, 12:17:45 PM
This is the patch I am using in both Magic and Tragic module, nothing has changed since the first time we found out about the mem fix.
Code: [Select]
 
+ if(buffers[j].size > buffers[j + 1].size) // > kisbuffer elöl


Tragic Lantern raw_rec.c has  "if(buffers[j].size < buffers[j + 1].size)" .. It's better to sort it the other way ?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 12:29:29 PM
Use the simulation script to find out.

Does that sorting algorithm actually work?! I can't understand it...
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 12:42:43 PM
These two last records doesn't work in photo mode.
But previous one was able to get as much as twice more frames compared to movie mode. What is the reason for that?
Raw record is disabled in photo mode, has nothing to do with the new versions here, it is just like that now.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 12:45:03 PM
Use the simulation script to find out.

Does that sorting algorithm actually work?! I can't understand it...
Sorting code makes a huge differ on this camera. I added the sorting code to Magic Raw, it was already on the Tragic Raw
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 12:50:17 PM
Tragic Lantern raw_rec.c has  "if(buffers[j].size < buffers[j + 1].size)" .. It's better to sort it the other way ?
To find out compare your results between Tragic and Magic, Magic uses it the opposite of Tragic.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 01:21:43 PM
Tragic Lantern raw_rec.c has  "if(buffers[j].size < buffers[j + 1].size)" .. It's better to sort it the other way ?



And I think it's better if the buffers are in ascending order (start writing ASAP):
Code: [Select]
/* Sort Buffers */
    static struct buff temp[10];
    for (int i = 0; i < buffer_count; i++)
        for(int j = 0; j < buffer_count- i - 1; j++)
           if(buffers[j].size > buffers[j + 1].size)
           {
                temp[j] = buffers[j];
                buffers[j] = buffers[j + 1];
                buffers[j + 1] = temp[j];
           }

(It seems it's no longer in the unified?)


Some test results here, on 550D with SanDisk ExtremePro 16GB, at 1280x426 @ 24fps without HaCKeD mode:

Buffers                 FramesSeconds
2x31Mb68<3
2x31Mb + 9Mb26511
9Mb + 2x31Mb27411.4

My version is probably not up to date, so take this into account!
And I don't know how it may affect the other models btw, need reviews...
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 01:24:46 PM
Can you implement this buffering strategy in raw_rec and check if my theory is valid?

I'll check.
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 19, 2013, 01:58:48 PM
This version seems to run good for me, things I do with this one that helps is.
Turn Global Draw Off
Use FPS to set fps to 23.976 but 23 seems like it will go on forever
I was testing 1152x460
I use Canon Preview mode
And I used Magic Raw

But first try it with your normal settings you are use to and see if this version does better or worse.

If first record does not do good, try again and see how good next record does.

http://www.mediafire.com/download/25py137awp0s7x9/ML_550D_June_19_2013_Update.zip (http://www.mediafire.com/download/25py137awp0s7x9/ML_550D_June_19_2013_Update.zip)

UPDATE: After more tests I found this one was no better and recorded corrupted frames.

I'm getting pink frames with this one (*too). Never experienced this before, I think.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 02:15:21 PM
I'm getting pink frames with this one. Never experienced this before, I think.
Same here, that is why I put an update about it having corrupt frames.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 19, 2013, 02:25:31 PM
Sorting code makes a huge differ on this camera. I added the sorting code to Magic Raw, it was already on the Tragic Raw

So, do this can be inserted in the raw rec module with a conditional compile statement only for 550d? If the conditionals are not implemented for this module, do we can implement them? So, we can take advantage of different strategies on different cameras! Let me know!
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 02:44:17 PM
Updated the simulation formula, now it's matches the real numbers perfectly for all test cases I've tried.

https://bitbucket.org/hudson/magic-lantern/commits/7eee493f6fc9

There's no best strategy for sorting; in some cases it's best to use biggest buffers first, in others, smallest buffers first. I think you will get better overall results if you call sim_frames and decide the sorting direction on the fly, right after allocating the buffers.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 04:34:39 PM
Updated the simulation formula, now it's matches the real numbers perfectly for all test cases I've tried.

https://bitbucket.org/hudson/magic-lantern/commits/7eee493f6fc9

There's no best strategy for sorting; in some cases it's best to use biggest buffers first, in others, smallest buffers first. I think you will get better overall results if you call sim_frames and decide the sorting direction on the fly, right after allocating the buffers.


To be honest :), I also thought, that the more buffers are better, even if the overall size isn't bigger, I don't know why I haven't tried so far: D, but here it is:

Some really quick test results here, on 550D with SanDisk ExtremePro 16GB, 1280x426 @ 24fps:

SortingBuffers                                               FramesSeconds
asc8Mb+31Mb+31Mb317~13
desc16Mb+16Mb+15Mb+15Mb+8Mb1326~55
asc8Mb+15Mb+15Mb+16Mb+16Mb1395~58
none15Mb+15Mb+16Mb+16Mb+8Mb1326~55

Try and let me know:
http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar (http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar)

Great findings by the way a1ex, I'm still experimenting with this, and with your speedsym.py script.. looks like it worth the try :) thanks!



EDIT (9 x 8Mb):

SortingBuffers                                                                         FramesSeconds
-8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb1565~65
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 05:06:38 PM
Not always. Smaller buffers will reduce the write speed; the speed profile looks like this: http://www.magiclantern.fm/forum/index.php?topic=5471

Of course, the speed drop from 32M to 16M is very small, and the smaller granularity is useful here. But if the card is fast enough for continuous recording, it may work better with only the two 32MB buffers; the 8MB one may slow it down.

At startup and when the buffer is about to overflow, you want small buffers. In the middle of recording, when things are rolling smooth, you want large buffers. I'm investigating a writing strategy with variable buffer sizes, stay tuned.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 05:22:31 PM
I'm investigating a writing strategy with variable buffer sizes, stay tuned.

Me too :D
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 07:36:11 PM
The 9x8 looks close to optimal for this case. I've got only 1910 frames with the variable buffer method in simulation (compared to 1565 for 9x8MB).

A question for you: what write speed are you getting if you only write one frame at a time? (that is, split the buffers in very small chunks equal to frame_size - and as many as you can - should be 81 stars for the numbers above). This will be helpful in fine-tuning the speed curve.

Edit: current simulation results (1280x426, 23.976, speed tuned to 21.16MB/s to match 1565 frames):

8MB + 2x32MB - 317 frames:
(http://a1ex.magiclantern.fm/bleeding-edge/8%2B2x32MB.png)

9x8MB - 1566 frames:
(http://a1ex.magiclantern.fm/bleeding-edge/9x8MB.png)

Variable buffering, starting from 8MB + 2x32MB - 1910 frames:
(http://a1ex.magiclantern.fm/bleeding-edge/variable-buffering.png)

X: time in seconds; Y: number of buffered frames.

All 3 cases with the same write speed and the same amount of total memory.

Warning: this is pure theory, I didn't try this on any camera. But you can see the mathematical background behind raw recording, study the algorithms and suggest improvements.

Note: if write speed wouldn't vary with buffer size, the optimal algorithm would be trivial: just write one frame at a time.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 19, 2013, 07:53:53 PM
to my experience, sandisk extreme cards not only capable of writing sequentially but also in parallel. I think we can push more data into card with that strategy.
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 19, 2013, 07:59:06 PM
This is pretty awesome. Would this mean a few seconds of 1080p is possible?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 08:12:41 PM
No. At 1920x1080, the simulation says:
current method: 19 frames
optimized by splitting and reordering buffers: 27 frames
variable buffering: 25

At 1728x972: 24/34/34 frames.
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 19, 2013, 08:17:14 PM
No. At 1920x1080, the simulation says:
current method: 19 frames
optimized by splitting and reordering buffers: 27 frames
variable buffering: 25

At 1728x972: 24/34/34 frames.

And at 720p what is the max frames ?

Also if we shoot with the 2.35 ratio, how many frame @1920 ?

Thanks Alex :)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 08:20:56 PM
1280x720: 50/96/101.
1728x736: 31/50/51.

Try Xaint's zip, see if the theory makes any sense.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 19, 2013, 08:32:38 PM
No. At 1920x1080, the simulation says:
current method: 19 frames
optimized by splitting and reordering buffers: 27 frames
variable buffering: 25

At 1728x972: 24/34/34 frames.

just tried xaint's code, I can get

60 frames 1920x480
64 frames 1728x576
114 frames 1728x432
280 frames 1728x346
196 frames 1600x400
837 frames 1600x320
126 frames 1472x490
600 frames 1472x368
151 frames 1344x584
242 frames 1344x448
88 frames 1280x720
106 frames 1280x640
114 frames 1280x582
151 frames 1280x544
138 frames 1280x536
196 frames 1280x512
227 frames 1280x480
471 frames 1280x426
continuous recording 1280x320

all at 23.976fps with Sandisk Extreme 30MB/s 8GB
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 09:16:12 PM
Me too :D
DUDE!!!! That is much much BETTER!!!!! WOW!!!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 19, 2013, 09:26:40 PM
Yes, the method of 8Mb+15Mb+15Mb+16Mb+16Mb gives me 164 frames with 1280x536 at 23.976 fps for now. It's quite a step forward.

For example, recently i could get only 192 frames at 1152x482 at 24fps, now it is more than 730 (usually 739).
Title: Re: 550D raw video recording port official thread
Post by: dougie on June 19, 2013, 09:44:29 PM
great job, now getting continuous shooting @ 1152x432 on a 64GB sandisk extreme pro sdxc 95MB/s and the last rar posted by Xaint

other numbers are:

190f @ 1152x576 2:1
295f @ 1152x524 2.20:1
544f @ 1152x490 2.35:1
310f @ 1344x448 3:1
164f @ 1344x504 2.67:1
126f @ 1344x538 2.5:1
114f @ 1344x562 2.39:1
114f @ 1344x562 2.39:1
114f @ 1344x572 2.35:1
106f @ 1344x610 2.20:1
80f @ 1344x672 2:1
62f @ 1344x756 16:9
80f @ 1280x720 16:9
151f @ 1280x544 2.35:1
1010 @ 1280x426 3:1
280 @ 1280x480 2.67:1
666 @ 960x576 5:3
280 @ 960x640 3:2
Title: Re: 550D raw video recording port official thread
Post by: marekk on June 19, 2013, 09:57:02 PM
what should I change in raw_rec.c to allocate 16MB memory chunks instead of 32 ?
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 10:04:21 PM
The 9x8 looks close to optimal for this case. I've got only 1910 frames with the variable buffer method in simulation (compared to 1565 for 9x8MB).

A question for you: what write speed are you getting if you only write one frame at a time? (that is, split the buffers in very small chunks equal to frame_size - and as many as you can - should be 81 stars for the numbers above). This will be helpful in fine-tuning the speed curve.

Edit: current simulation results (1280x426, 23.976, speed tuned to 21.16MB/s to match 1565 frames):

Warning: this is pure theory, I didn't try this on any camera. But you can see the mathematical background behind raw recording, study the algorithms and suggest improvements.

Note: if write speed wouldn't vary with buffer size, the optimal algorithm would be trivial: just write one frame at a time.


I think it's not that easy :D

With frame_size sized buffers, it says 19.8Mb/sec  (~1100 frames). So I think we can rule this theory out :)

As I can see it now, it not just depends on the buffer size, but also on the resolution.   ??? Here's how:

With 1152x460 the 1x8Mb + 4x16Mb setup gives better results:

SortingBuffers                    FramesSeconds
asc9x8Mb4371~182
asc1x8Mb + 4x16Mb5168~215

But in 1280x426, inversely, the 9x8Mb gives the better results:

SortingBuffers                    FramesSeconds
asc9x8Mb1524~63
asc1x8Mb + 4x16Mb1395~58

The write speeds are better with the 1x8Mb + 4x16Mb setup, in BOTH cases! It says constant 21.0Mb/sec...
With 9x8Mb however it says 20.8-20.9Mb/sec in both cases!

All tests were performed twice, gives almost the same results! (but there may be some randomness... :D )


Maybe I'm stupid, but isn't it possible, that the 16Mb buffers are faster than the 8Mb ones?
If I believe in this diagram:
(http://inthefield.uw.hu/ML/loll.jpg)

I've lost track, help me out!!!  ;D  ;D ;D ;D ;D

EDIT: I think the write speed vary. A lot. :D
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 19, 2013, 10:09:32 PM

To be honest :), I also thought, that the more buffers are better, even if the overall size isn't bigger, I don't know why I haven't tried so far: D, but here it is:

Some really quick test results here, on 550D with SanDisk ExtremePro 16GB, 1280x426 @ 24fps:

SortingBuffers                                               FramesSeconds
asc8Mb+31Mb+31Mb317~13
desc16Mb+16Mb+15Mb+15Mb+8Mb1326~55
asc8Mb+15Mb+15Mb+16Mb+16Mb1395~58
none15Mb+15Mb+16Mb+16Mb+8Mb1326~55

Try and let me know:
http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar (http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar)

Great findings by the way a1ex, I'm still experimenting with this, and with your speedsym.py script.. looks like it worth the try :) thanks!



EDIT (9 x 8Mb):

SortingBuffers                                                                         FramesSeconds
-8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb+8Mb1565~65

http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar]http://www.mediafire.com/download/rkq9kh63po8xxg4/ML_550D_Xaint.rar

With this new xaint I get twice the number of frames!

8Mb+15Mb+15Mb+16Mb+16Mb

was getting:

80 frames at 1152x460 with 23.976 fps with my Kingston sd card which is the same speed as the sandisk 45 mb/s.

now getting

162 frames at 1152x460 with 23.976 fps with my Kingston sd card which is the same speed as the sandisk 45 mb/s.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 10:12:45 PM
what should I change in raw_rec.c to allocate 16MB memory chunks instead of 32 ?

I don't know whether I'm doing it well or not, a1ex will tell, but:

Code: [Select]
       
                buffers[buffer_count].ptr = (void*)(((intptr_t)ptr + 4095) & ~4095);
                buffers[buffer_count].size = size/2 - 8192;
                buffers[buffer_count].used = 0;

                buffers[buffer_count+1].ptr = (void*)(((intptr_t)ptr+size/2 + 4095) & ~4095);
                buffers[buffer_count+1].size = size/2 - 8192;
                buffers[buffer_count+1].used = 0;


                buffer_count+=2;
                total += size;
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 19, 2013, 10:24:22 PM
Okay guys, got some homework for you.

Take a look here: http://www.magiclantern.fm/forum/index.php?topic=5471

and run the same test (Debug - Card buffer benchmark), but this time in movie mode. The camera will shutdown after half an hour, so touch the half-shutter every now and then. Use any of the autoexecs from this thread.

Then post the logs.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 19, 2013, 10:32:05 PM
Okay guys, got some homework for you.

Take a look here: http://www.magiclantern.fm/forum/index.php?topic=5471

and run the same test (Debug - Card buffer benchmark), but this time in movie mode. The camera will shutdown after half an hour, so touch the half-shutter every now and then. Use any of the autoexecs from this thread.

Then post the logs.

As you wish sir!  :)

I think there is a lot of factors, that affects the write speed, including the card itself, the buffer distribution, the order of the buffers, the frame_size, (the varying cpu load maybe?) and so on.. So good luck a1ex to find the best solution, what works best in all cases! :)
I'll try to help if I can! :)
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 19, 2013, 11:00:33 PM
I've noticed sth about sandisk extreme 45mb/s cards. after 6 months of intense use write rates drops about 1mb/s, because I've recently bought 3 new 45MB/s cards and they are all faster than my older 2 45MB/s cards. I'm surprised to see the result, because I also have a sandisk extreme III 20MB/s edition 6 yr old, works at same performance all along.

anyone noticed sth like that?

and @a1ex, is it possible to partition eos m's memory like that?
Title: Re: 550D raw video recording port official thread
Post by: marekk on June 19, 2013, 11:09:25 PM
60D hangs with this ;)

I don't know whether I'm doing it well or not, a1ex will tell, but:

Code: [Select]
       
                buffers[buffer_count].ptr = (void*)(((intptr_t)ptr + 4095) & ~4095);
                buffers[buffer_count].size = size/2 - 8192;
                buffers[buffer_count].used = 0;

                buffers[buffer_count+1].ptr = (void*)(((intptr_t)ptr+size/2 + 4095) & ~4095);
                buffers[buffer_count+1].size = size/2 - 8192;
                buffers[buffer_count+1].used = 0;


                buffer_count+=2;
                total += size;
Title: Re: 550D raw video recording port official thread
Post by: dougie on June 19, 2013, 11:11:22 PM

With this new xaint I get twice the number of frames!

8Mb+15Mb+15Mb+16Mb+16Mb

was getting:

80 frames at 1152x460 with 23.976 fps with my Kingston sd card which is the same speed as the sandisk 45 mb/s.

now getting

162 frames at 1152x460 with 23.976 fps with my Kingston sd card which is the same speed as the sandisk 45 mb/s.


That's strange, I get 2242 frames @ 1152x460 23.976fps on a sandisk 95MB/s but the real bottle neck is the ~20MB/s 550d SD hw
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 19, 2013, 11:41:00 PM
Did my homework :)
Code: [Select]
Buffer size experiment
ML v2.3.NEXT.2013Jun19.550D109, f3631da68349+
Mode: movie 1920x1080 24p, Global Draw: OFF
Sandisk 16GB 45MB/s

10312704 195
15885312 202
80896 69
8949760 201
28661760 204
16264192 205
24521728 200
16424960 203
13148160 201
15619072 202
1658880 188
21001216 201
8548352 203
19760128 202
5965824 196
24906752 202
13968384 201
16770048 200
4542464 197
13063168 205
33263616 202
30312448 202
16713728 203
3887104 198
21841920 202
12846080 204
16192512 205
3333120 197
6719488 197
17313792 206
23374848 201
2865152 192
32488448 200
18588672 205
4186112 199
821248 179
3661824 200
18359296 201
19875840 201
22754304 205
13665280 202
24957952 203
28555264 203
33442816 205
10708992 200
20242432 203
8774656 199
11216896 203
23156736 201
12750848 201
12369920 204
2157568 188
15279104 203
29943808 200
30321664 204
19004416 206
268288 129
23778304 204
467968 152
1905664 194
32368640 204
19829760 203
26281984 200
24153088 204
11364352 202
32160768 204
5944320 199
24118272 204
28511232 204
31526912 205
15956992 203
1732608 193
13881344 205
6106112 198
17367040 204
21693440 200
30835712 201
1139712 177
13698048 205
19388416 203
1532928 186
16333824 203
15963136 202
23540736 205
23770112 205
7317504 201
6019072 201
13303808 202
32039936 204
13137920 199
24311808 201
25442304 204
8986624 202
25421824 204
2720768 191
18526208 202
12448768 202
6514688 199
6632448 199
17897472 202
26569728 205
22568960 205
11912192 200
22007808 204
30651392 202
29615104 204
18367488 203
21049344 201
15778816 203
24951808 202
5359616 199
23476224 201
17125376 201
3318784 194
12782592 204
30965760 202
1974272 194
32021504 206
24463360 202
28246016 206
23352320 204
27161600 203
25191424 205
10841088 203
22846464 202
19111936 201
26234880 204
32610304 202
14385152 202
18029568 203
11080704 201
3933184 197
22414336 201
8314880 200
27988992 204
20073472 205
23487488 203
30233600 204
25299968 202
2406400 193
28059648 204
2145280 190
27503616 201
20705280 205
28731392 202
2458624 191
19662848 204
6198272 199
21655552 205
32225280 201
21788672 202
16669696 202
12007424 202
4321280 196
14878720 204
10118144 199
2836480 191
21092352 202
17086464 202
1707008 192
17509376 205
28161024 204
18457600 201
16290816 201
10758144 203
17766400 203
28011520 203
19835904 201
11879424 203
18191360 202
12581888 201
15906816 205
6525952 199
30545920 200
934912 178
6738944 201
18920448 205
27171840 203
19916800 206
28598272 203
23926784 202
10470400 204
20392960 201
7282688 202
4824064 197
11820032 201
30988288 203
26221568 206
13527040 204
30140416 203
6785024 200
25762816 201
23324672 203
26011648 203
4475904 198
33500160 206
8732672 202
29461504 202
12411904 202
12294144 203
11481088 200
12786688 199
15858688 205
16142336 204
29415424 205
32114688 202
18460672 203
15672320 203
12832768 201
23447552 203
18734080 201
25832448 202
20690944 202
27086848 206
24894464 203
32919552 203
30015488 204
2870272 191
27643904 203
25778176 202
4189184 201
13642752 201
7861248 200
21999616 206
4232192 198
12140544 200
3162112 197
27608064 203
18791424 205
5019648 200
15958016 202
20426752 206
685056 164
18709504 202
6188032 201
6668288 203
30684160 200
9438208 204
20264960 205
1707008 192
4702208 202
27417600 201
31681536 204
1326080 183
9743360 201
29618176 204
28645376 201
21629952 207
21515264 211
 
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 19, 2013, 11:51:54 PM
WOW!!! 1725 frames at 1280x426x23.976  Very nice!!!
Title: Re: 550D raw video recording port official thread
Post by: 1% on June 19, 2013, 11:58:02 PM
I did this to 50D and write speed fell... but idle time did too.

Well thing is size/2 makes ~13mb buffers so maybe having them at 16MB would be ideal.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 20, 2013, 12:14:40 AM
I did this to 50D and write speed fell... but idle time did too.

Well thing is size/2 makes ~13mb buffers so maybe having them at 16MB would be ideal.

What do you mean that size/2 makes ~13Mb buffers? How big the size then? I don't know the 50D, in 550D we have 2x31Mb, and the remaining 7-8Mb from the 75Mb shoot_malloc.
Title: Re: 550D raw video recording port official thread
Post by: xaint on June 20, 2013, 12:24:39 AM
Homework :D

(The cam overheated, sorry. Today was the hottest day of the summer)

Mode: movie 1920x1080 25p, Global Draw: OFF
SanDisk ExtremePro 16GB

Code: [Select]

10312704 207
15885312 208
80896 86
8949760 207
28661760 208
16264192 206
24521728 209
16424960 207
13148160 208
15619072 206
1658880 195
21001216 208
8548352 206
19760128 208
5965824 204
24906752 207
13968384 207
16770048 207
4542464 202
13063168 206
33263616 208
30312448 208
16713728 208
3887104 203
21841920 206
12846080 207
16192512 207
3333120 202
6719488 204
17313792 207
23374848 206
2865152 198
32488448 208
18588672 207
4186112 203
821248 185
3661824 204
18359296 208
19875840 208
22754304 208
13665280 206
24957952 208
28555264 206
33442816 208
10708992 204
20242432 207
8774656 206
11216896 204
23156736 208
12750848 205
12369920 209
2157568 195
15279104 205
29943808 209
30321664 206
19004416 203
268288 145
23778304 209
467968 165
1905664 198
32368640 209
19829760 206
26281984 207
24153088 207
11364352 205
32160768 207
5944320 206
24118272 207
28511232 209
31526912 207
15956992 208
1732608 196
13881344 208
6106112 204
17367040 209
21693440 207
30835712 209
1139712 188
13698048 203
19388416 208
1532928 195
16333824 205
15963136 208
23540736 207
23770112 208
7317504 206
6019072 204
13303808 206
32039936 207
13137920 206
24311808 207
25442304 208
8986624 206
25421824 208
2720768 200
18526208 209
12448768 206
6514688 203
6632448 205
17897472 206
26569728 206
22568960 208
11912192 206
22007808 206
30651392 209
29615104 208
18367488 207
21049344 206
15778816 206
24951808 208
5359616 200
23476224 202
17125376 208
3318784 201
12782592 205
30965760 209
1974272 198
32021504 209
24463360 205
28246016 208
23352320 203
27161600 208
25191424 206
10841088 206
22846464 208
19111936 207
26234880 207
32610304 209
14385152 207
18029568 208
11080704 205
3933184 201
22414336 208
8314880 204
27988992 209
20073472 207
23487488 208
30233600 205
25299968 208
2406400 196
28059648 208
2145280 196
27503616 207
20705280 208
28731392 207
2458624 198
19662848 208
6198272 204
21655552 208
32225280 206
21788672 207
16669696 206
12007424 205
4321280 201
14878720 207
10118144 205
2836480 200
21092352 207
17086464 205
1707008 194
17509376 205
28161024 208
18457600 206
16290816 207
10758144 204
17766400 204
28011520 208
19835904 202
11879424 205
18191360 208
12581888 203
15906816 208
6525952 203
30545920 206
934912 186
6738944 204
18920448 204
27171840 208
19916800 207
28598272 207
23926784 207
10470400 206
20392960 206
7282688 201
4824064 202
11820032 207
30988288 205
26221568 204
13527040 207
30140416 204
6785024 202
25762816 207
23324672 205
26011648 205
4475904 200
33500160 205
8732672 206
29461504 207
12411904 203
12294144 207
11481088 205
12786688 205
15858688 206
16142336 203
29415424 206
32114688 208
18460672 205
15672320 206
12832768 207
23447552 206
18734080 206
25832448 206
20690944 207
27086848 206
24894464 208
32919552 207
30015488 208
2870272 197
27643904 208
25778176 206
4189184 202
13642752 204
7861248 203
21999616 202
4232192 202
12140544 206
3162112 201
27608064 208
18791424 204
5019648 203
15958016 208
20426752 207
685056 174
18709504 206
6188032 204
6668288 205
30684160 207
9438208 204
20264960 206
1707008 192
4702208 204
27417600 208
31681536 206
1326080 192
9743360 207
29618176 206
28645376 208
21629952 206
21515264 206
12170240 205
29555712 206
2771968 198
30593024 209
23996416 206
31484928 208

Title: Re: 550D raw video recording port official thread
Post by: intrinsic on June 20, 2013, 01:53:14 AM
Is this buffering aspect has anything to do with increasing card write speed at lower FPS using FPS override? Or is it CPU problem?
I've first noticed that on 5dMkII, and 550D shows the same, it goes up to 22Mb/s at the beginning of the recording (than drops around 21), @FPS 8-12
Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 20, 2013, 02:31:30 AM
hey guys!

good to hear from the writing strategy.
i thought about something like this by myself. but more in a way of interlacing the image and writing it in blocks to the card.
maybe storing it randomly on the card, so the card can be written on with a constant speed continuously?

i don´t know how the dng files are actually contained as one file. if they are in sequence or already randomly stored.
is it possible to generate a mft type list in that container to restore the correct sequence in the unpacking process on the computer?

or maybe a kind of pre record strategy. you could arm the raw recording process=>buffer gets filled and rewritten for an "optimal" amount and circles for 10 seconds. then kills itself to prevent heat and to safe battery.
then you hit the fire button and the card can take the optimal data stream.

what´s the h264 coder doing? in the 50D it has to be activated to get raw recording.

this is just theory. and of course i don´t know if anything of this is possible or even already implemented.

would love to help with coding, but my coding days started and stopped with the C64...



and i did some more practice tests. wondered, what the also increased motion resolution (compared to interframe based h264. means, h264 dumps not just color and detail information by macro blocking but also motion information which is stored in vectors)

so here you have it: horrible resolution and a nightmare of aliasing but a synthesized 200 fps camera (shot 50fps)

Title: Re: 550D raw video recording port official thread
Post by: qsara on June 20, 2013, 02:49:59 AM
50D + ML = 55D, 550D + ML = 555D, Chuck Norris of DSLRs' :)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 20, 2013, 07:33:47 AM
Yes, writing out of order will help a little with buffer fragmentation. But we have to change the file format too (add a tag for each frame), so it will break the converters.

It's on the list for next major file format update.
Title: Re: 550D raw video recording port official thread
Post by: Ivoprod on June 20, 2013, 09:04:39 AM
Just Imagined what if Camera could have around 2 gb or 4 gb buffer size , and then doesn't metter what card we have just record until the limit in desired resolution and fps and , wait until it gets on card !

how real is buffer stratch ? and if canon will do it , how high will grow price of the same 550d like camera?
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 20, 2013, 12:14:08 PM
Just Imagined what if Camera could have around 2 gb or 4 gb buffer size , and then doesn't metter what card we have just record until the limit in desired resolution and fps and , wait until it gets on card !

how real is buffer stratch ? and if canon will do it , how high will grow price of the same 550d like camera?

1D X has it, but its forbidden to touch :)
Title: Re: 550D raw video recording port official thread
Post by: frontloop on June 20, 2013, 12:24:59 PM
1D X has it, but its forbidden to touch :)

AND its forbidden to sell it for $500 ...
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 20, 2013, 03:45:07 PM
AND its forbidden to sell it for $500 ...

never heard of it, why?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 20, 2013, 04:33:40 PM
The new and latest xaint build version with better buffers is ready to download : the headpost is fresh updated !  8)
Thankyou xaint, from all of us !  ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 20, 2013, 05:57:15 PM
Anyone wanting to try out Alex's experimental variable buffer Raw Record, this build is all updated and has AUTO ETTR, File Manager and Pic View Module as well.

http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip (http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip)
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 20, 2013, 06:18:44 PM
Anyone wanting to try out Alex's experimental variable buffer Raw Record, this build is all updated and has AUTO ETTR, File Manager and Pic View Module as well.

http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip (http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip)

Thanks a lot, it's working even better than Xaint build !!! Amazing !!
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 20, 2013, 06:19:40 PM
Anyone wanting to try out Alex's experimental variable buffer Raw Record, this build is all updated and has AUTO ETTR, File Manager and Pic View Module as well.

http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip (http://www.mediafire.com/download/hgiq49uyo3uk7pl/ML_550D_June_20_2013_Update.zip)

Wow ! We are among a head-to-head contest here ! what buffer strategy will win ? time will tell !

In the meantime, also your build was put on the headpost ! Many thanks mk11174 !
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 20, 2013, 06:22:20 PM
My results with variable buffering compared to xaint's build 1x8Mb + 4x16Mb method:

res            fps               fr.xaint          fr.variable     boost       

1280x536   23.976 fps      164               236               44%
1280x536   23 fps            184               276               50%

1280x512   23.976 fps      196               303               54%
1280x512   23 fps            238               364               53%

1152x482   23.976 fps      739               1157             56%

Screenshots:
[spoiler](http://moredo.ru/raw/VRAM3.BMP)
(http://moredo.ru/raw/VRAM4.BMP)
(http://moredo.ru/raw/VRAM5.BMP)
(http://moredo.ru/raw/VRAM6.BMP)
(http://moredo.ru/raw/VRAM7.BMP)[/spoiler]

A1ex, this theory actually works indeed.

Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 20, 2013, 06:36:11 PM
Wow ! We are among a head-to-head contest here ! what buffer strategy will win ? time will tell !

In the meantime, also your build was put on the headpost ! Many thanks mk11174 !
No contest, lol!! Those 2 both put there heads together to come up with this I think, those guys are awesome for sure!
Title: Re: 550D raw video recording port official thread
Post by: Trombom on June 20, 2013, 07:04:45 PM
Hi, so why my final RAW VIDEO in canon t2i appear very cropped ? and this can be for my sd card speed? i use a "transcend sdhc class 10 32gb", i put the config: 640x360px but i cant get 1280x720px with no cropping, so what i need to have the exactly view i have in my viewport? Thanks, help!

(http://rwmstudios.com/problemcropped.jpg)
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 20, 2013, 07:09:26 PM
You need to use a fisheye lens ;)

There is another way though. Find the menu item that says "raw video" and switch it to "off".

Or, even better, start the camera without Magic Lantern. It's not targeted at beginners.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 20, 2013, 07:13:25 PM
You need to use a fisheye lens ;)

There is another way though. Find the menu item that says "raw video" and switch it to "off".

Or, even better, start the camera without Magic Lantern. It's not targeted at beginners.

Best response ever   :)
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 20, 2013, 07:28:15 PM
You need to use a fisheye lens ;)

There is another way though. Find the menu item that says "raw video" and switch it to "off".

Or, even better, start the camera without Magic Lantern. It's not targeted at beginners.

LOL
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 20, 2013, 07:35:10 PM
Alex disabled debug code and added a bit more speed as it says on the changeset.

http://www.mediafire.com/download/fkby2xwlo3bqcbb/ML_550D_June_20_2013_Update01.zip (http://www.mediafire.com/download/fkby2xwlo3bqcbb/ML_550D_June_20_2013_Update01.zip)
Title: Re: 550D raw video recording port official thread
Post by: CFP on June 20, 2013, 07:51:28 PM
Hi, so why my final RAW VIDEO in canon t2i appear very cropped?
Because that's the way it works.

The raw videos are the LiveView images. And if you use a resolution that is smaller than 1734 X 1155 that's just a crop of the whole image ;D
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 20, 2013, 08:24:54 PM
I think I've made a huge mistake by selling my other 550D to get EOS M. 550D's RAW has better aliasing and nice dof if you use 50 1.8, well, I hope that buffer adjustment imported to eos m too, otherwise I'm not using it anymore rather than h264
Title: Re: 550D raw video recording port official thread
Post by: jagnje on June 20, 2013, 08:55:46 PM
hey guys!

good to hear from the writing strategy.
i thought about something like this by myself. but more in a way of interlacing the image and writing it in blocks to the card.
maybe storing it randomly on the card, so the card can be written on with a constant speed continuously?

i don´t know how the dng files are actually contained as one file. if they are in sequence or already randomly stored.
is it possible to generate a mft type list in that container to restore the correct sequence in the unpacking process on the computer?

or maybe a kind of pre record strategy. you could arm the raw recording process=>buffer gets filled and rewritten for an "optimal" amount and circles for 10 seconds. then kills itself to prevent heat and to safe battery.
then you hit the fire button and the card can take the optimal data stream.

what´s the h264 coder doing? in the 50D it has to be activated to get raw recording.

this is just theory. and of course i don´t know if anything of this is possible or even already implemented.

would love to help with coding, but my coding days started and stopped with the C64...



and i did some more practice tests. wondered, what the also increased motion resolution (compared to interframe based h264. means, h264 dumps not just color and detail information by macro blocking but also motion information which is stored in vectors)

so here you have it: horrible resolution and a nightmare of aliasing but a synthesized 200 fps camera (shot 50fps)

Nice shots. Do I undesrtand corectly...you shot this in 50fps and slowed it down to 25%?
Title: Re: 550D raw video recording port official thread
Post by: notdabod on June 20, 2013, 09:26:42 PM
Hi, so why my final RAW VIDEO in canon t2i appear very cropped ? and this can be for my sd card speed? i use a "transcend sdhc class 10 32gb", i put the config: 640x360px but i cant get 1280x720px with no cropping, so what i need to have the exactly view i have in my viewport? Thanks, help!

(http://rwmstudios.com/problemcropped.jpg)

This happened to me as well the first time. I couldn't figure out why things are so cropped then I saw the crop marks and I realized it's how we can shoot raw by making it cropped.

Come on guys give them a break it's not like there's a manual for the stuff.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 20, 2013, 09:39:47 PM
Is there any possibility to try some other resolutions, say 1200x500 (1:2.4) ?
Title: Re: 550D raw video recording port official thread
Post by: crash-film on June 20, 2013, 09:40:21 PM
hey jagnje,

i recorded it in 50 fps. interpreted as 25 fps or slowed down to 50% gives you a flawless 1/2 speed real slow motion.
if you slow it down by another 50% using sth like twixtor or the foundrys kronos or the retime component of saphire plug ins or any other software using optical flow you can get a real good 1/4 speed interpolated slomo.

but it´s important to shoot with the highest shutter speed possible. the less motion blur you have in your images the better the motion flow based image interpolation works. you can even lower the software slow motion to 25% and still get medium to good results.
but the algorithms really start to struggle with those speeds and warping becomes more and more visible (see the close of the fountain).
it also depends on the image content.

it´s more something to play with than with real value
Title: Re: 550D raw video recording port official thread
Post by: Trombom on June 20, 2013, 10:07:10 PM
You need to use a fisheye lens ;)

There is another way though. Find the menu item that says "raw video" and switch it to "off".

Or, even better, start the camera without Magic Lantern. It's not targeted at beginners.

Thanks for nothing.
Title: Re: 550D raw video recording port official thread
Post by: Trombom on June 20, 2013, 10:12:19 PM
Because that's the way it works.

The raw videos are the LiveView images. And if you use a resolution that is smaller than 1734 X 1155 that's just a crop of the whole image ;D

Very thanks going to try.
Title: Re: 550D raw video recording port official thread
Post by: CFP on June 20, 2013, 11:11:37 PM
Thanks for nothing.
Do you realize that he's one of the developers which made this amazing feature possible? They are sacrificing their time to push our little cameras to the limit. "Thanks for nothing" ... No offence but that was a realy stupid comment. Without a1ex we wouldn't even have the RAW feature on any DSLR ;)
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 20, 2013, 11:16:49 PM
Without a1ex we wouldn't even have the RAW feature on any DSLR ;)

We wouldn't even have Magic Lantern...
Title: Re: 550D raw video recording port official thread
Post by: core_32 on June 20, 2013, 11:19:39 PM
We wouldn't even have Magic Lantern...
We wouldn't even have DSLRs  ;)
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 20, 2013, 11:24:10 PM
We wouldn't even have DSLRs  ;)

Lol, we wouldn't be alive also maybe ;)
Title: Re: 550D raw video recording port official thread
Post by: Ivoprod on June 20, 2013, 11:25:03 PM
Progress , thank you Guys for doing this ! 1280x512(2.50:1) - 24fps - 7sec , 1344x538(2.50:1) - 24 fps - 5 sec , 1344(3:1) 24fps - 9 sec, 1280(3:1) 24fps - 13 sec

,ADATA 32GB Class 10 Max write it can give me is 16.8 MB/S , ML_550D_June_20_2013_Update01
Title: Re: 550D raw video recording port official thread
Post by: CFP on June 20, 2013, 11:30:52 PM
We wouldn't even have Magic Lantern...
A1ex != Trammell Hudson ... Or have I missed anything? ;D
Title: Re: 550D raw video recording port official thread
Post by: jagnje on June 20, 2013, 11:59:15 PM
hey jagnje,

i recorded it in 50 fps. interpreted as 25 fps or slowed down to 50% gives you a flawless 1/2 speed real slow motion.
if you slow it down by another 50% using sth like twixtor or the foundrys kronos or the retime component of saphire plug ins or any other software using optical flow you can get a real good 1/4 speed interpolated slomo.

but it´s important to shoot with the highest shutter speed possible. the less motion blur you have in your images the better the motion flow based image interpolation works. you can even lower the software slow motion to 25% and still get medium to good results.
but the algorithms really start to struggle with those speeds and warping becomes more and more visible (see the close of the fountain).
it also depends on the image content.

it´s more something to play with than with real value

ok, I know about twixtor...haven`t been able to use it in a manner that I would be pleased, but I haven`t tweaked it much yet. I just thought that your footage was without twixtor, that that much vector information is unlocked in RAW, because if it was that would be really good :) Filming skateboarding in super slo-mo without renting expensive cameras...
oh well :)
Can`t wait for a stable release with at least 15sec of flawless continous footage.
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 21, 2013, 12:30:42 AM
Thanks for nothing.

Yeah, because you're asking the teacher for help when you didn't even try to read the instructions or do the homework.
Title: Re: 550D raw video recording port official thread
Post by: dpiximaj on June 21, 2013, 04:53:57 AM
with a1ex latest patch I'm getting consistently 1400 - 1490 frames @ 23.976 1280 x 426, Extreme 45mb card woohoo! Thanks!
Title: Re: 550D raw video recording port official thread
Post by: jagnje on June 21, 2013, 07:43:30 AM
that would be my setup exactly. can you post a clip or two of the footage?
cheers
Title: Re: 550D raw video recording port official thread
Post by: rideBMX on June 21, 2013, 09:51:46 AM
@dpiximaj

I just wanted to ask, how did you get so much frames? I had the exact same setup (45mb SanDisk, 1280 x 426 @ 23.976) and I got 820 - 830 frames consistently.

Could you please tell me what your other settings were?

Thanks a lot!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 10:06:07 AM
I just wanted to ask, how did you get so much frames? I had the exact same setup (45mb SanDisk, 1280 x 426 @ 23.976) and I got 820 - 830 frames consistently.
Could you please tell me what your other settings were?
Just tried 1280x426 at 23.976 fps — i got 1689 frames on Sandisk extreme pro 95 mb/s
Make sure your global draw is off. Otherwise your card may be a bum.
Title: Re: 550D raw video recording port official thread
Post by: rideBMX on June 21, 2013, 10:08:25 AM
Just tried 1280x426 at 23.976 fps — i got 1689 frames on Sandisk extreme pro 95 mb/s
Make sure your global draw is off. Otherwise your card may be a bum.

I also turned Global Draw OFF :/
Title: Re: 550D raw video recording port official thread
Post by: hammermina on June 21, 2013, 12:35:53 PM
i got countinius shooting at 1280*388 in 720p mode at 23,97fps
and in 1080p mode at 1280*544 191 frames..

on my lexar 30mb/s

massive;-)
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 12:50:20 PM
I've added a couple of numbers to raw_rec.c and now i'm getting around 490 frames (>20 sec) with 1200x500 (nice 2,4:1 aspect ratio). Stable, no pink frames. This is already enough for me to film entire short totally in raw workflow.

550d
1080p 24 fps mode
23.976 fps override
global draw off
Sandisk extreme pro 95 mb/s

p.s. I've added just a 1200 px to the list of resolution choices and my favorite 2.4:1 aspect ratio.
I guess there are much more aspects affecting resolution choices, like DMA cropping routines etc, but 1200 works for me.

upd. Latest A1ex's optimizations (speculative start) doesn't give me any performance increase (as he mentioned, they won't), but either doesn't produce any bugs or artifacts like empty frames etc.
Title: Re: 550D raw video recording port official thread
Post by: MaKsOZ on June 21, 2013, 02:34:54 PM
Would you mind sharing your build ? 8)
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 21, 2013, 02:59:21 PM
This is starting to look quite good! Thanks devs!

I've just found out that my fastest cards are not the Transcends (as I thought, while I wait for the Sandisks*), but one called MFC that I hadn't even bothered testing. The Transcends write around 15-16mo/s, while this one gets to 18-19mo/s if the recording lasts a bit.

The problem is that the speed is very inconsistent. Sometimes it starts at 15mo/s and goes up, but some other times it shows 4mo/s or lower and the buffer gets filled quicker. I have the impression A1ex's last update (speculative start) might help a bit... don't know how to check this for sure, as the problem is randomish. Has this been studied? I remember this card was really cheap back when I bought it.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 03:18:54 PM
ML on 550D works best with Sandisk Extreme (new) Series, 30MB/s & 45MB/s, don't bother getting a 95MB/s because it is both expensive and 550D has 21MB/s bottleneck on SD controller
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 21, 2013, 03:23:46 PM
ML on 550D works best with Sandisk Extreme (new) Series, 30MB/s & 45MB/s, don't bother getting a 95MB/s because it is both expensive and 550D has 21MB/s bottleneck on SD controller

I know, I actually meant Sandisk :P Thanks
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 03:38:30 PM
Would you mind sharing your build ? 8)
ML raw rewind 1 (http://moredo.ru/raw/ML%20raw%20rewind%201.zip)

- Latest speculative start optimization
- 1200 px horiz. rezolution and 2.4:1 aspect ratio added

Upd. multiples of 16 works better, so i edited 2.4:1 into 2.42:1, this gives me 1200x496 and 500+ frames.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 03:42:06 PM
ML on 550D works best with Sandisk Extreme (new) Series, 30MB/s & 45MB/s, don't bother getting a 95MB/s because it is both expensive and 550D has 21MB/s bottleneck on SD controller

Disagree. My 8GB Sandisk extreme pro 95 MB/s gives me 30 to 50% more frames than 8GB Sandisk extreme pro 45 MB/s.
I think the reason is that 45 MB/s Sandisk cards have real write speeds just in the range of the sd controller's bottleneck (20-21 MB/s), whereas the 95 MB/s ones speeds exceeds this values.
Title: Re: 550D raw video recording port official thread
Post by: CFP on June 21, 2013, 03:59:47 PM
My 8MB Sandisk extreme pro 95 MB/s gives me 30 to 50% more frames than 8MB Sandisk extreme pro 45 MB/s.
8 Megabyte? How do you shoot RAW on these thing? ;D
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 04:03:46 PM
8 Megabyte? How do you shoot RAW on these thing? ;D
Typo ) Post now corrected
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 04:28:09 PM
Disagree. My 8GB Sandisk extreme pro 95 MB/s gives me 30 to 50% more frames than 8GB Sandisk extreme pro 45 MB/s.
I think the reason is that 45 MB/s Sandisk cards have real write speeds just in the range of the sd controller's bottleneck (20-21 MB/s), whereas the 95 MB/s ones speeds exceeds this values.

I'm able to record 1250 frames with 45MB/s where you can record 1440 frames with 95MB/s, its not a 30 to 50 percent increase ;)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 21, 2013, 04:44:58 PM
Wow, great progress, guys. Going to try this tonight, when I'm back from work!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 04:56:24 PM
I'm able to record 1250 frames with 45MB/s where you can record 1440 frames with 95MB/s, its not a 30 to 50 percent increase ;)
You're right. It was an obsolete information about 30 to 50 percent. New buffering optimizations makes slower cards act better.
Latest tests give me the numbers like this:

Sandisk 45MB/s        Sandisk 95MB/s
450 frames               530 frames

still notable difference in 18%

(1200x496 @23.976 fps)
Title: Re: 550D raw video recording port official thread
Post by: rideBMX on June 21, 2013, 04:57:59 PM
I really don't understand why you all are getting more than 1250 frames, I still can't get more than 800-820 frames and often just 500 :(

Global Draw is off
1280 x 426 (3:1)
1080p mode @ 23.976fps
Sandisk Extreme Pro 45mb/s 16GB

Anyone have an idea?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 05:06:59 PM
I really don't understand why you all are getting more than 1250 frames, I still can't get more than 800-820 frames and often just 500 :(
...
Anyone have an idea?


In this mode 1280x426 (3:1)
With this (http://moredo.ru/raw/ML%20raw%20rewind%201.zip) build i can get 1100-1200 frames with sandisk 45, and 1640-1650 with sandisk 95, so there is again difference in about 50%.
I think there are more things going on besides just writing speeds here.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 05:24:54 PM
In this mode 1280x426 (3:1)
With this (http://moredo.ru/raw/ML%20raw%20rewind%201.zip) build i can get 1100-1200 frames with sandisk 45, and 1640-1650 with sandisk 95, so there is again difference in about 50%.
I think there are more things going on besides just writing speeds here.

you're a troll, and I'm not feeding you.

show me a video proof of your claim or stop posting about percentages ;)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 21, 2013, 05:56:09 PM
ML_550D_June_20_2013_Update01

Getting linking error when loading modules.

undefined symbol 'raw_lv_shave_right'
[E] failed to link modules
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 06:00:27 PM
you're a troll, and I'm not feeding you.

show me a video proof of your claim or stop posting about percentages ;)

Come on, man. are you serious? )) What's the reason for trolling?
Specially for you:

Sorry for my English, have to practice more.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 06:16:42 PM
Come on, man. are you serious? )) What's the reason for trolling?
Specially for you:

Sorry for my English, have to practice more.

a nice educational video for newcomers, but have you ever seen I mentioned extreme pro?? Extreme 45MB/s cards newer than Extreme Pro 45MB/s cards.

 SanDisk Extreme Pro 8 GB SDHC Flash Memory Card SDSDXP1-008G
 Date first available at Amazon.com: January 17, 2011

 SanDisk Extreme 16 GB SDHC Class 10 UHS-1 Flash Memory Card 45MB/s SDSDX-016G-AFFP
 Date first available at Amazon.com: April 1, 2012

sincerely, a troll hunter ;)
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 06:21:33 PM
a nice educational video for newcomers, but have you ever seen I mentioned extreme pro?? Extreme 45MB/s cards newer than Extreme Pro 45MB/s cards.

Oh, that's clears the air )
I haven't heard of those new sandisks. Will try if i'll find them out there.
By the way, what are the results with these new cards at the same settings? (1280x426 23,976)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 21, 2013, 06:26:08 PM
Guys, I don't know what you did, but with "ML_550D_June_20_2013_Update" I am getting continuous recording in 5x mode at 1344x448 (3:1) and 20fps (Hi Jello setting).

At 21fps >788 frames!

AMAZING!

Some more tests:

1472x490 @18fps = 478 frames
1472x552 @18fps = 178 frames

I am using Toshiba Exceria Type 2 60MB/s card

ML_550D_June_20_2013_Update01 still does not work. Anyone else having this issue?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 21, 2013, 06:26:35 PM
ML_550D_June_20_2013_Update01

Getting linking error when loading modules.

undefined symbol 'raw_lv_shave_right'
[E] failed to link modules
You must have an old module still on card, best to delete everything and add the update from yesterday

Everything is same in that build except Alex removed debug code and I don't have any issue loading on my card, but now I am using todays build anyway which has more fixes.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 06:27:09 PM
Oh, that's clears the air )
I haven't heard of those new sandisks. Will try if i'll find them out there.
By the way, what are the results with these new cards at the same settings? (1280x426 23,976)

avg 1200, mostly 1250

just captured exactly 3210 frames at "23fps"

(http://fc02.deviantart.net/fs71/f/2013/172/9/8/vram2_by_weraqs-d6a0g92.jpg)
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 06:41:13 PM
my test shows 1715 frames, so 37% increase vs 1250.

Just tried that at 23 fps. Stopped recording manually after 5000 frames.
Do you agree eventually, that pro 95MB/s has better performance, and still may be the reason to pay more for it?

By the way, i've got my 8GB for less then $25 in god damn Russia, i'm pretty sure you can get it even cheaper in US or Europe. So that is not too expensive, right?
Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 21, 2013, 06:42:59 PM
1472x490 @18fps = 478 frames
1472x552 @18fps = 178 frames

I am using Toshiba Exceria Type 2 60MB/s card


anyone using this toshiba Exceria card?
ive been searching and searching till now, this is the best fastest card @lower price i can find.

price: 60mb/s 16gb@54 (in my country)
compared to:
scandisk 30mb/s 16gb@55
scandisk 45mb/s 16gb@88
scandisk 95mb/s 16gb@159

type1 rated @90mb/s
type2 rated@60mb/s
the speed seems legit :)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 21, 2013, 06:44:30 PM
I formatted the card on a computer, then did low level formatting in camera. Copied all files from the ML_550D_June_20_2013_Update01 folder and prepared a card. Still the same error when loading modules. This can not be a coincidence. I even re-downloaded the archive

UPDATE: Got it working. Not sure what happened.

I noticed that I am getting slightly more frames in 1:1 mode than without it.
Title: Re: 550D raw video recording port official thread
Post by: qsara on June 21, 2013, 06:53:08 PM
my test shows 1715 frames, so 37% increase vs 1250.

Just tried that at 23 fps. Stopped recording manually after 5000 frames.
Do you agree eventually, that pro 95MB/s has better performance, and still may be the reason to pay more for it?

I know sandisk extreme cards, been using only on my cameras for last 6 years. but in my country, to get sandisk extreme pro you have pay 2,5x more than sandisk extreme series, for example,

SDHC sandisk extreme 16GB is 36$ (but I can get them at 25$ from a friend)
SDHC sandisk extreme pro 16GB is 83$

I've chosen capacity rather than speed because I don't like to carry my 17,3" laptop with me all time in case of card gets full.

the only thing I'm disagree with you is it doesn't really matter (like %30 to %50) if you put fast card on 550D, it has 21MB/s limit.
Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 21, 2013, 07:05:48 PM
the only thing I'm disagree with you is it doesn't really matter (like %30 to %50) if you put fast card on 550D, it has 21MB/s limit.

i believe the 95mb card will almost write @21mb constantly, so thats why it will record longer.
other slower card will jump up and down around 21mb.

thats what i test all my card with crystalDiskMark.
my slow class6 card even sometime write at 4mb then 11mb :(
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 21, 2013, 07:18:10 PM
i believe the 95mb card will almost write @21mb constantly, so thats why it will record longer.
other slower card will jump up and down around 21mb.

That's exactly what i've been talking earlier and what my tests proves.
Obviously, there is no any reason to buy a card faster than 21MB/s, but what real life tests shows us, is not every card has the speeds manufacturer declares. My idea is to chose the card that is just fast ENOUGH to do the job of 21MB/s.

Sandisk extreme pro 95MB/s does this job. Other cards i have... don't.
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 22, 2013, 01:45:10 AM
Hoping to get a little help from you Adobe Premier users. I am trying to figure out the speed/duration of tiffs brought into Premier. I shot the raw files at 23.976 FPS and I have 472 tiffs. I have divided FPS into 472 and get 19.69. I tried setting speed/duration to 20 but resulting video looks wrong.
Can someone assist?
Title: Re: 550D raw video recording port official thread
Post by: nightvision04 on June 22, 2013, 02:00:11 AM
Try these steps:

- create new bin
- right click bin folder, click import, select all .tif sequence file.
- click bin folder
- click automate to sequence (sequence icon)
- select desired settings, click OK

from: http://www.cgpinoy.org/t16507-importing-tif-files-to-adobe-premier-as-a-sequence#301289
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 22, 2013, 02:43:55 AM
Come on, man. are you serious? )) What's the reason for trolling?
Specially for you:

Sorry for my English, have to practice more.

Interesting. I wish I had found this info when I ordered my new cards. A very small increase in speed makes a difference with the new improvements.
Title: Re: 550D raw video recording port official thread
Post by: noisyboy on June 22, 2013, 02:49:55 AM
Those of you struggling with getting the higher write speeds with the new hack... Try formatting exfat and post your results :)
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 22, 2013, 03:17:34 AM
Those of you struggling with getting the higher write speeds with the new hack... Try formatting exfat and post your results :)
What tool do you use to format, and what allocation unit size do you use?
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 22, 2013, 03:36:16 AM
Those of you struggling with getting the higher write speeds with the new hack... Try formatting exfat and post your results :)

Same or worse results with exfat
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on June 22, 2013, 03:37:50 AM
I'm excited that I finally figured out the workflow and programs to get a raw video clip. Here it is
http://www.youtube.com/watch?v=Uon7wAUuVQ0&feature=c4-overview&list=UUVGqLf_wyBiTXT7PIam8foQ (http://www.youtube.com/watch?v=Uon7wAUuVQ0&feature=c4-overview&list=UUVGqLf_wyBiTXT7PIam8foQ)

I know its nothing special but it feels pretty good to actually get something done...lol



Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 22, 2013, 08:07:58 AM
strange happened to me now.... it seems i cant get the raw video size past 1728 :(

someone have any idea?

i was able to do it yesterday playing with it... (even with 1fps)
damn i still have the raw file in my laptop for 2512x1080 @14fps
now i it keep saying more than 1728 is not supported in video mode :( :(
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 22, 2013, 09:16:44 AM
So, guys, is the information of the top post still up-to-date?
Where should I start my investigations to dig into that?
Are there any new clues and ideas how to achieve more memory on ours 550d's?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on June 22, 2013, 09:53:34 AM
CONFIG_MARK_UNUSED_MEMORY_AT_STARTUP

(dangerous)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 22, 2013, 10:07:28 AM
strange happened to me now.... it seems i cant get the raw video size past 1728 :(

someone have any idea?

i was able to do it yesterday playing with it... (even with 1fps)
damn i still have the raw file in my laptop for 2512x1080 @14fps
now i it keep saying more than 1728 is not supported in video mode :( :(
You must activate 5x zoom before going to ml menu to select resolution
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 22, 2013, 10:08:31 AM
strange happened to me now.... it seems i cant get the raw video size past 1728 :(

someone have any idea?

i was able to do it yesterday playing with it... (even with 1fps)
damn i still have the raw file in my laptop for 2512x1080 @14fps
now i it keep saying more than 1728 is not supported in video mode :( :(

The max resolutions that can be read from the 550D sensor are: 1728*1156 in canon's 1080 mode. 2512*1080 in cropped mode. 1728*694 in canon's 720P mode. That's if I'm not missing something, and of course at really low framerates. You must have recorded that bigger file in cropped mode (x5 zoom).
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 22, 2013, 10:19:38 AM
In order to use the CONFIG_MARK_UNUSED_MEMORY_AT_STARTUP i have to define it in internals.h, right?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 22, 2013, 10:23:47 AM
So, guys, is the information of the top post still up-to-date?
Where should I start my investigations to dig into that?
Are there any new clues and ideas how to achieve more memory on ours 550d's?
Yes it is kept up to date by me, as soon as devs will inform me about their developments or as soon as I see developments on this or other threads
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 22, 2013, 11:21:52 AM
Does someone a have a recent and complete build of Tragic?

EDIT: solved: http://www.mediafire.com/download/96zgrdjaubamjuh/ML_Fileman_Raw_Tragic.zip I can't use the more recent ones, don't know why.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 22, 2013, 11:41:47 AM
Just to be sure: do 550d raw video have a chroma subsamplig 422 or 420 or something else? And do the one of h264 is the same? Many thanks!
Title: Re: 550D raw video recording port official thread
Post by: marregi on June 22, 2013, 11:48:08 AM
Just to be sure: do 550d raw video have a chroma subsamplig 422 or 420 or something else? And do the one of h264 is the same? Many thanks!

I did some qualifiers in resolve for secondaries and by the quality of the keying (no blocking, compresion artifacts etc) I guess is 422 but I´ve to test it with hair in greenscreen to tell you the truth. Or maybe someone can give us a more detailed explanation about chroma subsampling here..
Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 22, 2013, 12:40:40 PM
You must activate 5x zoom before going to ml menu to select resolution

oh that solved it!
haha time to play more~
thanks a lot!
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 22, 2013, 02:16:20 PM
I did some qualifiers in resolve for secondaries and by the quality of the keying (no blocking, compresion artifacts etc) I guess is 422 but I´ve to test it with hair in greenscreen to tell you the truth. Or maybe someone can give us a more detailed explanation about chroma subsampling here..

Ok, I figured out from info around the internet and inside the audio narration of this video : http://www.how-to-diy.org/8OFpfFiXrDDLOY/Raw-%22Video%22-on-Canon-DSLRs-with-Magic-Lantern.html

H264 video is YUV subsampled to 4:2:0
RAW video is YUV subsampled to 4:2:2

Great values !  ;D
Title: Re: 550D raw video recording port official thread
Post by: NedB on June 22, 2013, 04:37:25 PM
@dlrpgmsvc: I believe you are half correct. H.264 is indeed YUV, subsampled at 4:2:0. But the raw video that ML now delivers is, according to a1ex himself in a tweet to Stu Maschwitz, 14-bit RGGB, that is: uncompressed, not-yet-debayered, 14-bits per pixel data straight from the sensor, with the only intermediate step being Canon's mysterious, black-box reduction (binning? line-skipping? both?) of the sensor resolution of 5184x3456 down to the Live View resolution, which varies by camera and is apparently 1728x974 for the 550D. Though it is true that the sensor array has twice as many sensels (?) for the G channel as it does for R and B, I don't think it's correct to call it either YUV or 4:2:2. IMHO, of course. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 22, 2013, 05:05:53 PM
I don't think it's correct to call it either YUV or 4:2:2. IMHO, of course. Cheers!

Yes, you are perfectly right ! It is simply RAW, so no YUV represented yet, and no chroma and/or luma subsampling at all, right !
Title: Re: 550D raw video recording port official thread
Post by: Chagalj on June 22, 2013, 06:58:33 PM
1280x512  2.5:1 ratio 23,976 fps ----------   310 frames!!! This is usable!!!
Sandisk Pro 95MB/s
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 22, 2013, 09:39:38 PM
Guys, is there a guide for noise reduction? I am getting a lot of noise by default, even at ISO100 :(
Title: Re: 550D raw video recording port official thread
Post by: shawnwytch on June 22, 2013, 09:46:42 PM
You must activate 5x zoom before going to ml menu to select resolution

so when u go into 5x mode and u change the raw resolution, the bar that pops up showing u what your recording  area is. Is it showing u the real form factor. I notice its there when your in normal mode, does it adjust for if your in normal mode or 5x mode.
or is it guessing?
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 22, 2013, 10:48:10 PM
1280x512  2.5:1 ratio 23,976 fps ----------   310 frames!!! This is usable!!!
Sandisk Pro 95MB/s

My thoughts exactly, out with cam today and getting 360 - 390 frames each time, same settings and card as your's. Rewinds recent build.

At those frame numbers I found still needed to be careful when to start and sometimes missed the moment, drop out ending premature, then had to wait for whatever the bar thingy is at the top of the LV to write to the card before starting next shot, so thinking better to maybe switch off stop at skip and just skip frames to keep some sort of continuity, if this is at all possible with latest developments? Assume the log file logs dropped frames for help at edit time?

Only other thing I haven't sorted yet is having got into the habit of 5x & 10x zoom for focus help when not using raw, now find 10x crashes the camera, obviously well known, but how to get out of 5x once in it? Pressing the minus zoom button doesn't seem to do anything once in 5x.
Title: Re: 550D raw video recording port official thread
Post by: dougie on June 22, 2013, 11:09:36 PM

Only other thing I haven't sorted yet is having got into the habit of 5x & 10x zoom for focus help when not using raw, now find 10x crashes the camera, obviously well known, but how to get out of 5x once in it? Pressing the minus zoom button doesn't seem to do anything once in 5x.

just turn the dial out of video mode then back in
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on June 22, 2013, 11:23:51 PM
dougie, thanks, I'd not tried that.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 23, 2013, 01:01:07 AM
so when u go into 5x mode and u change the raw resolution, the bar that pops up showing u what your recording  area is. Is it showing u the real form factor. I notice its there when your in normal mode, does it adjust for if your in normal mode or 5x mode.
or is it guessing?
never tested it with your requested precision, if you have time to test it, i'm interested in your results, thanks
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 23, 2013, 01:24:22 AM
Only other thing I haven't sorted yet is having got into the habit of 5x & 10x zoom for focus help when not using raw, now find 10x crashes the camera, obviously well known, but how to get out of 5x once in it? Pressing the minus zoom button doesn't seem to do anything once in 5x.
Just go into ML Prefs menu and goto LiveView zoom tweaks and turn off 10x zoom when you plan to use Raw Record, this way you wont use 10x by accident.
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 23, 2013, 04:26:43 AM
Guys, is there a guide for noise reduction? I am getting a lot of noise by default, even at ISO100 :(

A certain amount of noise in dark areas is unavoidable. Maybe you are keeping the shadows too bright in post. ACR does a nice job reducing noise, and also ETTR should help in many cases. If you really wanted bright shadows, you could try filming HDR, but that's a whole extra workflow on top of RAW.

so when u go into 5x mode and u change the raw resolution, the bar that pops up showing u what your recording  area is. Is it showing u the real form factor. I notice its there when your in normal mode, does it adjust for if your in normal mode or 5x mode.
or is it guessing?

That area is not useful in cropped mode. The recorded image is actually larger than what you see in the whole live view. You can compose the frame by selecting ML or Hacked preview in the Raw menu.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 23, 2013, 09:12:03 AM
what are the technical reasons for which we cannot use 10x crop mode for raw video recording just to help finding a solution?
Title: Re: 550D raw video recording port official thread
Post by: Ivoprod on June 23, 2013, 09:24:07 AM
just turn the dial out of video mode then back in

Just press MENU and back to live view
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 23, 2013, 10:04:32 AM
Here's another test with mk11174's build


Settings:
Canon's 1080p@24fps mode
ISO 100
1344x448 @ 20fps (Hi Jello)
5x mode
Toshiba Exceria Type 2 16GB card

Settings in Lightroom:

Luminance = 0
Color = 45
Detail = 100

Sharpening = 10

WB

Temp = 5050
Tint = 0

Everything else as is. Noise reduction blurs details significantly, regardless of how I tweak different settings, so I 've set it to 0.
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 23, 2013, 10:43:12 PM
Here's my first attempt at shooting RAW. The workflow is a lot bigger, but worth every second I think!


Shot in 1088x480 @ 24 frames per second with a 16GB Sandisk Extreme 45mb/s.

RAW > RAW2DNG > 14-bit DNG's > Adobe Camera Raw > .tif image sequence > Adobe Premiere CS6 > upscaled to 1080p > rendered out to .H264
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 24, 2013, 01:48:36 AM
Here's my first attempt at shooting RAW. The workflow is a lot bigger, but worth every second I think!

Shot in 1088x480 @ 24 frames per second with a 16GB Sandisk Extreme 45mb/s.

RAW > RAW2DNG > 14-bit DNG's > Adobe Camera Raw > .tif image sequence > Adobe Premiere CS6 > upscaled to 1080p > rendered out to .H264

How did you upscaled it ? What you used ?
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 24, 2013, 10:31:06 AM
How did you upscaled it ? What you used ?

I put the 1088x480 footage into a 720p sequence in Premiere and simply 'scaled to comp' and then my entire edited sequence into a 1080p sequence and used Instant HD and upscaled it to 1080p. Looks alright I think, though I'd probably just stick to 720p next time.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 24, 2013, 12:30:54 PM
I put the 1088x480 footage into a 720p sequence in Premiere and simply 'scaled to comp' and then my entire edited sequence into a 1080p sequence and used Instant HD and upscaled it to 1080p. Looks alright I think, though I'd probably just stick to 720p next time.

You did a great job: things that appear blurred are blurred by lens and wanted as is, because the sand touched by waves and waves on the horizon are very crisp and detailed, so upscaling is very good indeed ! Very good, compliments !
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 24, 2013, 12:43:40 PM
You did a great job: things that appear blurred are blurred by lens and wanted as is, because the sand touched by waves and waves on the horizon are very crisp and detailed, so upscaling is very good indeed ! Very good, compliments !

Thanks, man. Appreciate the kind words!  :)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 24, 2013, 12:55:45 PM
For those of you who want a quick command line solution without any processing (and free!). Install ffmpeg. From command line switch to a directory with exported tif files, then run:

Code: [Select]
ffmpeg -f image2 -r [your frame rate] -pattern_type glob -i '*.tif' -vcodec libx264 -preset ultrafast -qp 0 -pix_fmt yuv422p movie.mkv
-r sets frame rate value
-pattern_type glob -i '*.tif' scans all tif files from the current directory
-vcodec libx264 -preset ultrafast -qp 0 -pix_fmt yuv422p means fast x264 compression with highest quality setting and YUV 422 chroma subsampling

If you need to upscale, then add [-sws_flags lanczos -s WxH] . For example to upscale 1344x488@20fps to 1920x640 :

Code: [Select]
ffmpeg -f image2 -r 20 -pattern_type glob -i '*.tif' -vcodec libx264 -preset ultrafast -qp 0 -pix_fmt yuv422p -sws_flags lanczos -s 1920x640 movie.mkv
This is a very fast way to export. You can use -preset veryslow, then files will become less in size, but it's time consuming.

And here's another test:

Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 25, 2013, 07:45:04 PM
been playing with raw for weeks,
i got some black frame sometimes. (not sure when it will occurs)

all frames on that raw after converted to dng is all black, in camera preview is black too.
im sure the i have LV showing when i do the recording.

this is a known issues?
(ive read ppl getting some bad frames, but not whole clip is black)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 25, 2013, 09:04:41 PM
been playing with raw for weeks,
i got some black frame sometimes. (not sure when it will occurs)

all frames on that raw after converted to dng is all black, in camera preview is black too.
im sure the i have LV showing when i do the recording.

this is a known issues?
(ive read ppl getting some bad frames, but not whole clip is black)

You can write down as much details as possible (Canon mode, ML mode, fps override, resolution, at what frame numbers appears the black frame... and so on), so we can build a case-history to track down the problems about bad-pink-black-screwed-up frames that appears from time to time, many thanks !
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 25, 2013, 10:21:21 PM
In this mode 1280x426 (3:1)
With this (http://moredo.ru/raw/ML%20raw%20rewind%201.zip) build i can get 1100-1200 frames with sandisk 45, and 1640-1650 with sandisk 95, so there is again difference in about 50%.
I think there are more things going on besides just writing speeds here.

Excellent work dude, amazing!  :) Is there any plans to add 1088 as a resolution to future builds?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 26, 2013, 08:45:03 AM
Excellent work dude, amazing!  :) Is there any plans to add 1088 as a resolution to future builds?
That's not my work, dude. Thanks to devs, A1ex & co. )
Also thanks to mk11174, who made this great tutorial (http://www.magiclantern.fm/forum/index.php?topic=5582.msg50265#msg50265) for code-starters )

Watch it, and then you'll can easily add whatever resolutions you want, and much more (that's exactly what i've done: just added a couple of numbers to raw_rec.c file).
At it best, you will want to dig in, and hopefully find some interesting ideas about memory allocation, buffering and other delicious stuff... So welcome aboard )
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 26, 2013, 08:47:20 AM
I actually can't install Rewind's build. It keeps giving me error when I load modules. How do I update from mk11174's build? Just copy>replace files, right?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 26, 2013, 08:54:06 AM
I actually can't install Rewind's build. It keeps giving me error when I load modules. How do I update from mk11174's build? Just copy>replace files, right?

That build compiled with just raw_rec module. You have to disable or delete other modules in order to use it.
Title: Re: 550D raw video recording port official thread
Post by: Kornowski on June 26, 2013, 10:33:37 AM
That's not my work, dude. Thanks to devs, A1ex & co. )
Also thanks to mk11174, who made this great tutorial (http://www.magiclantern.fm/forum/index.php?topic=5582.msg50265#msg50265) for code-starters )

Watch it, and then you'll can easily add whatever resolutions you want, and much more (that's exactly what i've done: just added a couple of numbers to raw_rec.c file).
At it best, you will want to dig in, and hopefully find some interesting ideas about memory allocation, buffering and other delicious stuff... So welcome aboard )

Ah, didn't realise, sorry! I'll certainly give that a watch, thanks man!
Title: Re: 550D raw video recording port official thread
Post by: ph2007 on June 26, 2013, 05:42:16 PM
You can write down as much details as possible (Canon mode, ML mode, fps override, resolution, at what frame numbers appears the black frame... and so on), so we can build a case-history to track down the problems about bad-pink-black-screwed-up frames that appears from time to time, many thanks !

canon mode im using is 1080p 30fps
ML mode not 100% sure,
-did use fps overrite (23.967 and lower as well)
-no memory hack
-resulotion i did use alot of combinations ( hard to tell w/o the clips now )
-its not numbers of black framesm its the whole clips was black frames
-seems only occur the first few recordings after turn on the camera ( might be the 1st second or 3rd), all my others clip that record behind seems to be fine.

i will try to playing it more, to get more infos (i didnt keep the black clips :(  )
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 26, 2013, 05:49:40 PM
http://www.mediafire.com/download/ml5w13p2nxvja7a/ML_550D_June_26_2013_Update.zip (http://www.mediafire.com/download/ml5w13p2nxvja7a/ML_550D_June_26_2013_Update.zip)
Title: Re: 550D raw video recording port official thread
Post by: CharlieA56 on June 26, 2013, 06:02:30 PM
Anything around here with ETTR for the 500D/T1i ?
Thanx !  :)
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on June 26, 2013, 06:34:28 PM
http://www.mediafire.com/download/ml5w13p2nxvja7a/ML_550D_June_26_2013_Update.zip (http://www.mediafire.com/download/ml5w13p2nxvja7a/ML_550D_June_26_2013_Update.zip)

mk11174, what update is this? What does it include?
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 26, 2013, 06:53:06 PM
mk11174, what update is this? What does it include?
Latest changes to everything. Includes modules, Raw_Rec, File_Man, Pic_View and ETTR, oh and a requested res of 1200 and aspect 2.42:1
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 26, 2013, 07:05:25 PM
Anything around here with ETTR for the 500D/T1i ?
Thanx !  :)
For 500D only http://www.mediafire.com/download/smdzbpc94xqdfjm/ML_500D_June_26_2013_Update.zip (http://www.mediafire.com/download/smdzbpc94xqdfjm/ML_500D_June_26_2013_Update.zip)
Title: Re: 550D raw video recording port official thread
Post by: CharlieA56 on June 26, 2013, 07:12:45 PM
Wow... Thanx a lot Mr. mk11174 (I hope that's just your serial #  :P ).
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on June 26, 2013, 07:16:42 PM
Wow... Thanx a lot Mr. mk11174 (I hope that's just your serial #  :P ).
No problem, and you can call me Matt  :D
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 26, 2013, 09:06:34 PM
People using twixtor - is interpolating 18fps to 24 a big deal? Will the result look acceptable?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 26, 2013, 09:22:09 PM
People using twixtor - is interpolating 18fps to 24 a big deal? Will the result look acceptable?
Sometimes results are acceptable, even with lots of blurred moving objects, but tweaking the twixtor may be really tricky:
http://youtu.be/tNSh3XctUl0
http://youtu.be/AHLABuolFOY
but i doubt you can shoot the action-movie with this technique )
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on June 26, 2013, 09:27:25 PM
wow, looks really nice!
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 27, 2013, 05:57:55 PM
People using twixtor - is interpolating 18fps to 24 a big deal? Will the result look acceptable?

12 to 24 should be better. I wouldn't use it at all if the image has much movement.
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 27, 2013, 06:30:56 PM
12 to 24 should be better. I wouldn't use it at all if the image has much movement.

Not really.  The less frames to interpolate the better.
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on June 28, 2013, 03:06:22 AM
Hi all,

I am relatively new to ML and would love to have RAW video on my 550D! Do we have a tutorial on how to install it, or is it the same process as the regular ML that I have?

Is ML RAW video on the 550D stable enough for continous recording (3-5mins)?

This is the kind of video that I would be using it for:
Title: Re: 550D raw video recording port official thread
Post by: CharlieA56 on June 28, 2013, 03:52:30 AM
Sometimes results are acceptable, even with lots of blurred moving objects, but tweaking the twixtor may be really tricky:
http://youtu.be/tNSh3XctUl0
http://youtu.be/AHLABuolFOY
but i doubt you can shoot the action-movie with this technique )

Can you show us a screen capture of the configuration you're using on Twixtor for this ?
Thanx a lot !
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 28, 2013, 08:52:12 AM
Hi all,

I am relatively new to ML and would love to have RAW video on my 550D! Do we have a tutorial on how to install it, or is it the same process as the regular ML that I have?

Is ML RAW video on the 550D stable enough for continous recording (3-5mins)?

follow the instructions on how to install magic lantern and install the 2.3 stable release. then come here and download the latest build from the first post of this thread, decompact it and replace the the files and folders on your camera memory card with the ones you have just decompacted. that is.    yes, it is stable but you have to choose a recording resolution and speed in fps that shows you a green color comment on the camera display bottom line. have fun!
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on June 28, 2013, 08:56:46 AM
follow the instructions on how to install magic lantern and install the 2.3 stable release. then come here and download the latest build from the first post of this thread, decompact it and replace the the files and folders on your camera memory card with the ones you have just decompacted. that is.    yes, it is stable but you have to choose a recording resolution and speed in fps that shows you a green color comment on the camera display bottom line. have fun!

Brilliant, thanks for the info! I may have just saved myself $4000+ on the 5D mkIII and new lenses for another year or so. :)

The majority of my videos are viewed at less than 720p anyway so the loss in resolution is no deal breaker. I'll give it a crack tonight or tomorrow.
Title: Re: 550D raw video recording port official thread
Post by: glubber on June 28, 2013, 09:21:37 AM
Hi all,

I am relatively new to ML and would love to have RAW video on my 550D! Do we have a tutorial on how to install it, or is it the same process as the regular ML that I have?

Is ML RAW video on the 550D stable enough for continous recording (3-5mins)?

This is the kind of video that I would be using it for:

To me it looks like you are shooting with a wide angled lens to capture the most possible of the rooms.

So keep in mind, if shooting RAW with the 550D you will have to sacrifice fps (around 12 instead of 24) to get the full sensor size format,
or you must live with a heavy crop of around 960x540 against 1920x1080 if you want to maintain 24 fps!
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on June 28, 2013, 09:45:40 AM
Not really.  The less frames to interpolate the better.

That's why. When twixtoring from 12 to 24 fps you are interpolating 50% of frames, because all the original ones match a new temporal position. If you twixtor 18 to 24, only 1 or 2 6 original frames will match their new temporal position, and 22 12 won't, so you will have 22 18 interpolated frames.

*Update: I've double checked (18 to 24), and it appears that 6 of 24 (25%) frames will be original. Still not as good as 50% (12 to 24), but much better than other combinations
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 28, 2013, 09:58:32 AM
Can you show us a screen capture of the configuration you're using on Twixtor for this ?
Thanx a lot !
Those my examples are nothing fancy: just standard frame rate conversion using motion-weighted blend and inverse w/Smart blend warping. Interprete your foitage as 18 fps or whatever fps it really was shot, then make comp as desired fps (24 in my case). It just works.
(http://moredo.ru/raw/twixtor_settings_1.jpg)

In order to use twixtor with moving objects, you will have to take advantage of foreground/background masks etc.
This tutorial (http://vimeo.com/32155510) i found on vimeo may be more helpful.
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on June 28, 2013, 12:20:55 PM
To me it looks like you are shooting with a wide angled lens to capture the most possible of the rooms.

So keep in mind, if shooting RAW with the 550D you will have to sacrifice fps (around 12 instead of 24) to get the full sensor size format,
or you must live with a heavy crop of around 960x540 against 1920x1080 if you want to maintain 24 fps!

Yep, you're right! I've just had a quick play and the crop does not work for my style of video - even at 10mm it's not usable.

Looks like it will have to be upgrade time :(
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 28, 2013, 05:43:18 PM
That's why. When twixtoring from 12 to 24 fps you are interpolating 50% of frames, because all the original ones match a new temporal position. If you twixtor 18 to 24, only 1 or 2 6 original frames will match their new temporal position, and 22 12 won't, so you will have 22 18 interpolated frames.

*Update: I've double checked (18 to 24), and it appears that 6 of 24 (25%) frames will be original. Still not as good as 50% (12 to 24), but much better than other combinations

18fps to 24fps is better than 12fps to 24fps.  The general rule is you want more frames.  I don't know exactly how twixtor works specifically, but I know for less ghosting and better quality you want more frames.
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on June 28, 2013, 05:51:43 PM
With the latest builds I'm getting a decent amount of time at 23.976fps around 720p quality.

1280x536: 10 seconds @ 23.976 fps
1200x502: 17 seconds @ 23.976 fps
1152x482: 36 seconds @ 23.976 fps

So for the standard 2.39:1 ratio, the crop isn't that bad.  I'm sure you can get more time if you use the 2.42:1 or 2.5:1 ratios too.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on June 28, 2013, 06:54:38 PM
With the latest builds I'm getting a decent amount of time at 23.976fps around 720p quality.

1280x536: 10 seconds @ 23.976 fps
1200x502: 17 seconds @ 23.976 fps
1152x482: 36 seconds @ 23.976 fps

So for the standard 2.39:1 ratio, the crop isn't that bad.  I'm sure you can get more time if you use the 2.42:1 or 2.5:1 ratios too.

Try to check the option to tolerate frame skipping, and tell me the results: only one frame lost every 10 or 36 seconds shouldn't be noticeable at all ! Let me know !
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 28, 2013, 07:01:34 PM
Try to check the option to tolerate frame skipping, and tell me the results: only one frame lost every 10 or 36 seconds shouldn't be noticeable at all ! Let me know !
It is obviously enough, with this buffering strategy, you will get a whole bunch of skipped frames after the first one :)
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on June 28, 2013, 11:35:54 PM
I had a play with my steadicam and RAW today. Unfortunately due to the crop the shakiness is not useable for me. Maybe if we can squeeze out 720p in the future it could be a goer?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on June 29, 2013, 11:17:51 AM
It seems that latest "small hacks" doesn't work on 550d, right?
This option gives me an error at 0. expected e3a00032, got 100
should we completely disable it in our builds?
Title: Re: 550D raw video recording port official thread
Post by: jamesonblade on June 29, 2013, 08:47:58 PM
EDIT: **False alarm, thankfully.


I thought I bricked my camera. I succesfully recorded and edited a raw .dng file at 1152 x ~~ continuously in 3:1. Somehow my camera was turning on even though the battery was nearly totally dead- The screen should have displayed the "change the battery pack" dialogue like it normally does once a camera is past a charge able to sustain basic camera functions-

There was no signal running to the viewfinder, but the shutter, when depressed, would make the flash pop up in any dial setting and fire off rapidly.

Scared me for a minute. So, another happy ML user here.
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on June 30, 2013, 10:29:31 PM
There was no signal running to the viewfinder, but the shutter, when depressed, would make the flash pop up in any dial setting and fire off rapidly.
Maybe it needs a psychologist?
Title: Re: 550D raw video recording port official thread
Post by: Chungdha on June 30, 2013, 11:13:57 PM
I tried it out finally with the Sandisk extreme pro 95mbs 32gb it can do 1152x482 and 23fps continuesly
Title: Re: 550D raw video recording port official thread
Post by: ddelreal on July 02, 2013, 07:38:59 AM
The work to this point has been amazing! I wonder though, have we hit a brick wall?
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on July 03, 2013, 12:36:54 PM
I'm using raw2dng.exe on Windows 7. It works great, EXCEPT when a file 'cuts out' during recording (I guess ran out of memory). Is this normal?

The .RAW files are still >100mb so there is data there - is there any way to get that data out?
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on July 03, 2013, 04:23:20 PM
There is instructions on how to merge the extra file with the first raw file on the forum, use the search function.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on July 04, 2013, 05:36:36 AM
I'm using raw2dng.exe on Windows 7. It works great, EXCEPT when a file 'cuts out' during recording (I guess ran out of memory). Is this normal?

The .RAW files are still >100mb so there is data there - is there any way to get that data out?

There's no way I know to recover these. However, make sure your camera is not set to power off after maybe 30 seconds or so. I experienced that early on and then realized it only powered off after I was successful and a minute had passed. I just assumed it was too much for the camera to handle....but then I realized that I had the camera to power down the display after a minute.
Title: Re: 550D raw video recording port official thread
Post by: sletts02 on July 04, 2013, 06:35:17 AM
There is instructions on how to merge the extra file with the first raw file on the forum, use the search function.
I tried searching but couldn't find a fix - can you please link me / give search terms.

There's no way I know to recover these. However, make sure your camera is not set to power off after maybe 30 seconds or so. I experienced that early on and then realized it only powered off after I was successful and a minute had passed. I just assumed it was too much for the camera to handle....but then I realized that I had the camera to power down the display after a minute.

Brilliant! The auto-off 30 seconds was my Achilles! I wondered why it stated continuous but was cutting out regardless, very helpful cheers!
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on July 04, 2013, 08:25:14 AM
I'm on a trip testing the Raw functionality in real situations.

The only thing I miss is the option (that other builds have) of turning GD off automatically when you start recording. Other than that, I'm quite optimistic about the results I'm getting at 1280 2.39 23.976fps and 1728 2.39 11.998fps (crossing fingers for Twixtor).
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on July 04, 2013, 05:01:06 PM
Anyone here tried fisheye or ultra wide angle lenses with RAW? What's the effect like in crop mode?
Title: Re: 550D raw video recording port official thread
Post by: a1ex on July 04, 2013, 05:25:25 PM
It reduces the FOV angle, so keep that in mind when correcting the distortion.
Title: Re: 550D raw video recording port official thread
Post by: xfornos on July 05, 2013, 02:42:06 PM
Hi a1ex, one question. I think that other people ask you this before, but I dont find it. If you and more people in this forum can make some improvements in the buffer of the 550d, it would be possible to record for example at 100 fps? in h264 of course.

Will be more improvements to film in RAW mode?

I made that 2 weeks ago, and I used fisheye in some clips. https://vimeo.com/68887628
Title: Re: 550D raw video recording port official thread
Post by: Rewind on July 07, 2013, 08:32:12 AM
I build the raw_rec module from pravdomil's source:
https://bitbucket.org/pravdomil/magic-lantern-hack/commits/all

Raw_rec has some tasty features like black bars and auto global draw off while recording.
It looks like this now on my 550d:
(http://moredo.ru/raw/VRAM2.jpg)
Nice, huh?
I've noticed a tiny but consistent frame count increase with this. For example, with my previous build i've got about 500–510 frames with 1200x496 at 24 fps, now i'm getting 550-570.

Also, there is a small present for those of you, who dare enough to shoot the tv works on 550d — nice 3X4 cropmark, useful for PAL world )

Other stuff is from unified.
You can try my ML set here (http://moredo.ru/raw/ML_07_07_2013_rewind.zip).

Notice: I have removed a large set of resolutions (useless for my works), and added 1200 and 1.42:1
This build also includes ETTR, file_man, pic_view.
See this thread (http://www.magiclantern.fm/forum/index.php?topic=5655.msg0#new) if you are interested.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 07, 2013, 08:53:40 AM
Do the ADTG fps override inserted into the new raw_rec module is working also for 550D or still only for 5Dmk2 ?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 07, 2013, 08:58:51 AM
@rewind: it is useful if the fork you compiled will be fused into unified with on-off menu options: do you know if the author will make a pull request and with the necessary on-off menu functions?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on July 07, 2013, 09:20:36 AM
@rewind: it is useful if the fork you compiled will be fused into unified with on-off menu options: do you know if the author will make a pull request and with the necessary on-off menu functions?
I can't see it in pull requests, but i'm not sure, i'm not really understand the structure of branches and how the work organized in general. So now what i'm doing here is just searching for good stuff and compile it for myself )
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on July 07, 2013, 01:33:56 PM
Rewind, thanks for the compile! So are you basically just searching the other forums (600d, Mark II) and locating great features and compiling them?

I need to watch mk11174's video on that again so I can assist :)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 09, 2013, 08:57:04 PM
This thread will keep open in order to discuss 550D raw development, but... now that the nightly build is integrated with the raw_rec module, do the builds linked in the first post have still reason to stay ?  ???
Title: Re: 550D raw video recording port official thread
Post by: Lucas480 on July 10, 2013, 01:18:43 PM
Hey Guys,

Now, on 550D can I choose picture quality? Perhaps,  the choise of Jpeg quality on this dslr can record at 1920x1080?  ::)
Maybe The choice of "raw-quality" for example to boost performance in "old camera".
I'm Full user of magic lantern but no developer.  :'(

Sorry I'm French, And i think my english is not very good for understand.  :P


"Record with no H264 codec on my 550D it's a dream! Thanks developer for this exploit"  :D
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on July 10, 2013, 02:00:14 PM
This thread will keep open in order to discuss 550D raw development, but... now that the nightly build is integrated with the raw_rec module, do the builds linked in the first post have still reason to stay ?  ???
I guess it depends if the nightly builds come with ettr, pic_view and file_man which the versions in here do come with, maybe these are important to some people, I have not used a nightly build in awhile so I am not sure what they included, I always build myself. If everyone is happy then I would say they are not needed. I have not noticed any new updates in a long time, I hope the developers have not given up on the ML developing.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on July 10, 2013, 04:33:38 PM
I guess it depends if the nightly builds come with ettr, pic_view and file_man which the versions in here do come with, maybe these are important to some people, I have not used a nightly build in awhile so I am not sure what they included, I always build myself. If everyone is happy then I would say they are not needed. I have not noticed any new updates in a long time, I hope the developers have not given up on the ML developing.

I agree! I know that I've seen the developers on other forums, so I know their time is pretty taken up by multiple platforms, but I would love to see if we could somehow allocate enough memory to at least get 1280 by 720 at 24fps. I was able to get that resolution at 12fps the other day with Rewind's build. So close I can almost taste it :)
Title: Re: 550D raw video recording port official thread
Post by: CharlieA56 on July 10, 2013, 07:26:42 PM
Is there any place in this forum where RAW video on the 500D/T1i is being discussed ?

I just installed the July 10 Unified to see if there is any progress... and I still have the same problem... the LV display freezes even thou the camera is still recording and only by hitting the PLAY button it can go back to normal.

And another thing... can I avoid the 1.40x stretch (vertical compression in this case) to be made in post ?

Thanx for any comments.

Here is one of those first tests...
Title: Re: 550D raw video recording port official thread
Post by: djdew on July 12, 2013, 02:56:21 PM
Friends, tell me please! Can you shoot video size 720 * 400 (for example) but that there were no black borders on the edges of the frame (left and right)! I mean, that would have been distributed across the entire surface of the frame, not just the crop. If I wrote is correct (sorry I'm from Russia, my English is not very good))))
Title: Re: 550D raw video recording port official thread
Post by: -sandro- on July 12, 2013, 03:30:44 PM
Hi, i just tried various frame rates, is it normal on 720p frames I get extreme moiré and bad quality (in terms of detail)? I'm not sure but maybe the real gain in resolution only starts at 1080p frames? Does 720p on 5d mk3 (the heaven for raw) look as bad ?
Title: Re: 550D raw video recording port official thread
Post by: Soupertrooper on July 13, 2013, 07:56:51 AM
Hi, i just tried various frame rates, is it normal on 720p frames I get extreme moiré and bad quality (in terms of detail)? I'm not sure but maybe the real gain in resolution only starts at 1080p frames? Does 720p on 5d mk3 (the heaven for raw) look as bad ?

I imagine to avoid moire you would need to get an anti aliasing filter. the 5d mk3 already has one built in I believe, so the shots look sharp and there is no false color.

From what I understand, I could be wrong.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 13, 2013, 11:52:08 AM
I imagine to avoid moire you would need to get an anti aliasing filter. the 5d mk3 already has one built in I believe, so the shots look sharp and there is no false color.

From what I understand, I could be wrong.

Not exactly. Every dslr has an antialias filter built in, but it serves only for photographic full resolution. The lower video resolution needs a more powerful antialias filter as an add-on. Mk3 has less moirè in raw video due to the fact that the max resolution is higher than all the Others cams can do (in raw video mode). More resolution = less moirè.
Title: Re: 550D raw video recording port official thread
Post by: CFP on July 13, 2013, 12:31:46 PM
Hi, i just tried various frame rates, is it normal on 720p frames I get extreme moiré and bad quality (in terms of detail)? I'm not sure but maybe the real gain in resolution only starts at 1080p frames? Does 720p on 5d mk3 (the heaven for raw) look as bad ?
On my EOS 600D even 1280 X 512 (2.5:1 aspect ratio) looks very good after upscaling it to 1920 X 769 (2.5:1 aspect ratio) if you use the right scaling and debayering algorithm. It looks as good as 1920 X 1080 H.264 in terms of aliasing and maybe even better in terms of moiré. So: No the 5D Mark III isn't the only camera that profits from the RAW videos.

But what exactly do you mean with '720p'? Do you mean, in the Canon menu you've set the resolution to 1080p or 640p and the width in the Magic Lantern menu to 1280 with 16:9 aspect ratio? Or have you set the resolution to 720p in the Canon menu too? It is important since the 1080p and 640p mode both have the same line skipping: Every third column and every third line. But the 720p mode uses a different skipping: everythird column but every fith line. The 720p mode has way worse aliasing because of the bigger gaps between the lines. It also means that the Canon 720p mode produces a squished image that needs to be streched in post. So for 1280 X 720 without good quality set the resolution in Canon menu to 640p (Every third line and every third column is read and the YUV buffer is smaller than in 1080p mode = more space for RAW and Magic Lantern) and in the Magic Lantern menu the width to 1280 and the aspect ratio to 16:9.

And to reduce moiré as far as possible you should use Adobe Lightroom or CameraRAW to debayer your footage. Everything else looks worse, even Davinci Resolve isn't as good as LR and CR.
Title: Re: 550D raw video recording port official thread
Post by: -sandro- on July 13, 2013, 03:58:21 PM
thank you, by "720p" I mean that I set 1280x720 16:9 in ML but the Canon setting was at 1080p24 so if it's the same line skipping as 640p the quality I'm seeing is the best one I can get, it just looks bad for being a "720P" image but I understand why now.
I'm upset the SD controller of our camera is stuck at 20MB/s meaning there's no real future for this one:(
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on July 14, 2013, 06:52:25 PM
Rewind I tried your latest ML and it seems to work great. Here is a video I put together shot at 1200x496 @ 23.976       
Title: Re: 550D raw video recording port official thread
Post by: CFP on July 14, 2013, 07:13:23 PM
the quality I'm seeing is the best one I can get, it just looks bad for being a "720P" image
I'm not using the 550D but the very similar 600D and in my opinion 1280 X 512 (2.5:1 aspect ratio | doesn't work coninuously ...) looks good if you edit it correctly.
You have to keep in mind that you're working with uncompressed and completely unedited bayer data. So using Adobe Lightroom or CameraRAW for debayering and a very good upscaling method to enhance detail is a must to get sharp images without aliasing and moiré.

If your 1280 X 720 videos look bad in your opinion I think you may have a weak spot in your workflow. But of course you're right, our cameras aren't really good for RAW videos since they have such slow SD-Controllers and very small buffers.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on July 15, 2013, 10:42:31 AM
I think he is referring to shooting in 720p canon mode. That sucks, you should not use it.
Title: Re: 550D raw video recording port official thread
Post by: samhodge on July 15, 2013, 12:34:30 PM
Hey Guys

I heard about your firmware a few weeks ago and thought I would try it out.

To me good colour accuracy and no compression is more important to me than resolution.

I work in visual effects so the thought of dealing with a stair stepped 8 bit moving image makes me shudder.

Anyway I put up a couple of tech tests stopping the exposure up and down with the firmware you have put out there:


My Cat, with fur detail which would get lost in compression


A bowl of fruit


It shows the dynamic range of the image, the compression artifacts are questionable, because you are looking at footage that is compressed out of Nuke and then compressed again in Vimeo.

Everything seems to work as it says on the tin.

What is a decent card to be using to get the maximum throughput. I bought a Class 10 Ultra SanDisk 30Mb/s Card but it scarely does about 8Mb/s in the camera.

Anyway hello from Adelaide, South Australia, I hope you are having a great day.

Sam
Title: Re: 550D raw video recording port official thread
Post by: renowilliams on July 15, 2013, 01:49:33 PM
Sam

You need to take the s off of https to get the link to work properly.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on July 15, 2013, 04:51:07 PM
Hey Guys

I heard about your firmware a few weeks ago and thought I would try it out.

To me good colour accuracy and no compression is more important to me than resolution.

I work in visual effects so the thought of dealing with a stair stepped 8 bit moving image makes me shudder.

Anyway I put up a couple of tech tests stopping the exposure up and down with the firmware you have put out there:


My Cat, with fur detail which would get lost in compression


A bowl of fruit


It shows the dynamic range of the image, the compression artifacts are questionable, because you are looking at footage that is compressed out of Nuke and then compressed again in Vimeo.

Everything seems to work as it says on the tin.

What is a decent card to be using to get the maximum throughput. I bought a Class 10 Ultra SanDisk 30Mb/s Card but it scarely does about 8Mb/s in the camera.

Anyway hello from Adelaide, South Australia, I hope you are having a great day.

Sam


Sam, your card should be fine. That is strange that you are only getting 8Mb/s in the camera. I have a pny (I believe) 35Mb/s card from some retail chain store (best buy, walmart, I forget...) and it usually getting around 19.5Mb/s. (by the way, don't expect much more than that. If you do switch brands, you don't necessarily have to get anything that is extremely fast as the camera can't output that fast. I assume you have the 550d.
Title: Re: 550D raw video recording port official thread
Post by: samhodge on July 16, 2013, 03:19:19 AM

Sam, your card should be fine. That is strange that you are only getting 8Mb/s in the camera. I have a pny (I believe) 35Mb/s card from some retail chain store (best buy, walmart, I forget...) and it usually getting around 19.5Mb/s. (by the way, don't expect much more than that. If you do switch brands, you don't necessarily have to get anything that is extremely fast as the camera can't output that fast. I assume you have the 550d.

Yes I have a Canon 550D, with a 18-200mm lens.

Yeah seems like it might be a dud card.

It is only doing 6MB/s write in the reader in my iMac.

I have a warranty claim in the SanDisk and they are being pretty helpful.

But now I know how easy it is I am starting to watch the price of a 50D on ebay.

One thing i am interested about is does the EXIF or meta data come across with a RAW recording into the DNG files.

It would be nice to know focal lengths and stuff (ISO, EV etc) of the end images, which could help with turnover of footage, otherwise you are going to need some pretty accurate pen and paper records while you shoot.

sam
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on July 16, 2013, 06:35:45 AM
I am not near my 550D at the moment, but can we record RAW while in 640 crop? I thought that was 1 -1 pixel crop mode, just wonder if we get better res but I'm not sure if we loose all the pixels around it (640 + ).
Title: Re: 550D raw video recording port official thread
Post by: glubber on July 16, 2013, 08:24:11 AM
Yes you can record in 640x480 crop, it's almost the same as x5 zoom crop.
The max resolution is a bit higher than 480, but not much (My 550D is not near at the moment too  :P )

BTW: I'm reading the forum almost every day, but somehow i lost track of the newest updates...
Just to be sure:
The latest RAW-build for 550D is in the regular nightlys?
And the newest rad2dng.exe is from marekk over at the 60D-Threat?

Thx
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on July 17, 2013, 02:21:27 AM
Here's some stubborn testing. I think the results are quite useful, with some issues here and there (moiré, obvious twixtoring...).


I haven't tried upscaling it to 1920 yet (can't keep the res on Vimeo anyway).
Title: Re: 550D raw video recording port official thread
Post by: maverick891 on July 17, 2013, 03:08:59 PM
The last build here was posted on June 26th. No updates since then or is there a nightly thread which I am missing?
Title: Re: 550D raw video recording port official thread
Post by: lotusexcelle on July 17, 2013, 08:19:11 PM
Just started testing latest build on my t2i.  I've only been able to get about 7 seconds at 1200x400 but that isn't bad, all things considered.  I also did a quick workflow trial run and found it to be insanely clunky - I hope 3rd parties build plugins that make it easier to deal with.  For now it is merely laborious. 

I'm interested (and will be following this thread) in how far the t2i can be pushed in terms of usable 24fps resolution.  I'm also interested in color bit depth - I'm finding information that seems to conflict.  My DNG files are 8 bit?  Is this normal for the t2i output?  Just a minor question and I'm not *really* looking for an answer in this thread. 

I AM however so impressed and excited with what everyone at ML and the others who work on these things... well I'm just about having seizures.  It is mind-blowing to me that hardware can be pushed this far... and what makes it even cooler is that its people that obviously love these cameras, love "tinkering", and love film. 
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on July 17, 2013, 09:57:25 PM
Here's some stubborn testing. I think the results are quite useful, with some issues here and there (moiré, obvious twixtoring...).

*snip*

I haven't tried upscaling it to 1920 yet (can't keep the res on Vimeo anyway).

Dig the video (two of my favorite cities). What was your workflow?
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 17, 2013, 11:53:29 PM
My DNG files are 8 bit?  Is this normal for the t2i output?  Just a minor question and I'm not *really* looking for an answer in this thread. 

They are exactly 14 bit of real bit depth. You can treat it as 16 bit because there we go at powers of two, but the real depth is 14 bit
Title: Re: 550D raw video recording port official thread
Post by: JuanIrache on July 18, 2013, 03:48:38 AM
Dig the video (two of my favorite cities). What was your workflow?

Cheers.

Most shots are 1280 1:1.39 ratio 23.976fps and shutter as close to 180º as possible (174º usually) + some cheap ND filters. Extracted with Batchelor (to save time) and imported to After Effects with ACR. No further colour correction.

The wider shots are 1728 at 11.988fps and 90º shutter, twixtored to 50%. I discarded footage with obvious Twixtor artifacts (most of it).

PS. Which cities? Cairo should be there as well, but I stayed at the airport because of the current situation :(.
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on July 18, 2013, 04:25:12 AM
Cheers.

Most shots are 1280 1:1.39 ratio 23.976fps and shutter as close to 180º as possible (174º usually) + some cheap ND filters. Extracted with Batchelor (to save time) and imported to After Effects with ACR. No further colour correction.

The wider shots are 1728 at 11.988fps and 90º shutter, twixtored to 50%. I discarded footage with obvious Twixtor artifacts (most of it).

PS. Which cities? Cairo should be there as well, but I stayed at the airport because of the current situation :(.
That's pretty much the workflow I use, except I do the cuts in premiere using a low quality proxy, open it in AE and replace with dngs through ACR.

Sydney (lived there for five years) and Bangkok (spent a few weeks at Thammasat University) - but back in Oslo now missing the southern climate.
Title: Re: 550D raw video recording port official thread
Post by: lotusexcelle on July 19, 2013, 10:58:09 PM
They are exactly 14 bit of real bit depth. You can treat it as 16 bit because there we go at powers of two, but the real depth is 14 bit

Very much appreciated!  Still kind of stunned this camera can handle this stuff.  Just have to get my workflow nailed down.
Title: Re: 550D raw video recording port official thread
Post by: hdx on July 20, 2013, 01:20:44 PM
The last build here was posted on June 26th. No updates since then or is there a nightly thread which I am missing?

This is the version I'm using (I do not have skill to compile source code myself) and it gives me a lot of corrupted DNG's after shooting silent pic timelapse.

Can someone post newer, compiled version?
Title: Re: 550D raw video recording port official thread
Post by: marregi on July 20, 2013, 03:10:07 PM
I´m using 26th june version with the raw_rec.mo from this 5D2 version http://www.magiclantern.fm/forum/index.php?topic=5533.0 (just replace the raw rec file) , no such a great improvement or longer recording, but the black frames are amazing for framing.
Title: Re: 550D raw video recording port official thread
Post by: johnhenryrupe on July 21, 2013, 08:49:06 PM
Hello, long time listener, first time caller.

I have a 550D (t2i) and have been messing around with the RAW video. Amazing to say the least. I've been through the forums and still have a few questions maybe someone could clear up.

1. I've been seeing talk about "line skipping" and shooting in "crop mode". Does this apply to the 550d. If so which is better to shoot with as far as the canon video settings (1920x1080 24p/30p, 1280x720 60p, or the 640 modes)? I'm experimenting with the RAW resolutions to find the best it can output to, I like 960x540, and 1280x426 @ 24fps.

2. moire! I'm getting alot, any thoughts?

3. Kinda related to the first question. It seems people are zooming in (x5) in liveview and then recording. Does this apply to the 550d, or the other higher end canons?

Anyway, any input would be great. I'm already getting wonderful results. I've been scaling everything to 720 width and things are going great, but of course I wanna get the best picture as possible.

Thanks and here's some links to tests I have on youtube.


Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on July 22, 2013, 10:26:33 AM
1. I've been seeing talk about "line skipping" and shooting in "crop mode". Does this apply to the 550d. If so which is better to shoot with as far as the canon video settings (1920x1080 24p/30p, 1280x720 60p, or the 640 modes)? I'm experimenting with the RAW resolutions to find the best it can output to, I like 960x540, and 1280x426 @ 24fps.

Yes, it applies to 550D too. Crop mode (shooting by engaging first 5x zoom mode) is best, because there is no line skipping as in other modes, but it's very zoomed in, so there are pros and cons.

2. moire! I'm getting alot, any thoughts?

You can slightly defocus in post (worse method) or use a filter on the sensor (best method). You can search for "vaf filter" in internet, and on the post where all the cameras ML capabilities are listed: open the spreadsheet and read on the bottom right, near to the legend. Using crop mode (aid method) aids to mitigate the problem. Also, higher the resolution, less the moirè effect.

3. Kinda related to the first question. It seems people are zooming in (x5) in liveview and then recording. Does this apply to the 550d, or the other higher end canons?

Yes, this applies also to 550D and produces "crop mode" results as per answer [1]
Title: Re: 550D raw video recording port official thread
Post by: Rewind on July 22, 2013, 04:44:46 PM
Recieved one Vaf-Txi filter recently. It fits perfectly, but that's the only good news ))
When switching on / entering LV mode, shutter pops, camera gives me an Err 20 and stops.

Has anyone the same experience with 550d and vaf-txi ?
Title: Re: 550D raw video recording port official thread
Post by: johnhenryrupe on July 23, 2013, 01:43:42 AM
dlrpgmsvc

Thanks for the information. Especially clearing up the x5 crop situation. I did end up reading all the 34 pages on this thread and that also answered my questions. Recommend doing the same to anyone that is having issues, definitely worth your time. Didn't mean to repeat questions already asked but the x5 zoom thing just seemed counter-intuitive to me, but hey whatever works! Keep up the fantastic work everyone.

Cheers
Title: Re: 550D raw video recording port official thread
Post by: Soupertrooper on July 23, 2013, 12:38:15 PM
Recieved one Vaf-Txi filter recently. It fits perfectly, but that's the only good news ))
When the mirror goes down and hits the filter, camera gives me an Err 20 and stops.

Has anyone the same experience with 550d and vaf-txi ?

You should talk to the company you bought it from. VAF filters are expensive and if they're selling them at high prices they should work without messing with the mirror.
Title: Re: 550D raw video recording port official thread
Post by: blazraidr on July 23, 2013, 04:03:38 PM
Another test with RAW video. Shot using kit lens 55-250mm, in 5x zoom mode.

720p in 3:1 ratio, recorded at 23.976 fps until buffer filled up. Utilised Auto ETTR to get the most usable data from RAW.

Title: Re: 550D raw video recording port official thread
Post by: pavelpp on July 24, 2013, 11:03:42 AM
Wow, impressed!
Title: Re: 550D raw video recording port official thread
Post by: Seb86 on July 25, 2013, 04:49:36 AM
@blazraidrout

Can you PLEASSSE explain how you can use the 5x zoom mode while filming Raw video?

I tried it but couldn't figure it out...
Title: Re: 550D raw video recording port official thread
Post by: ilguercio on July 25, 2013, 04:53:11 AM
@blazraidrout

Can you PLEASSSE explain how you can use the 5x zoom mode while filming Raw video?

I tried it but couldn't figure it out...
How? Put in 5x zoom and start recording...
Title: Re: 550D raw video recording port official thread
Post by: Seb86 on July 25, 2013, 05:05:45 AM
How? Put in 5x zoom and start recording...

That doesn't work for me.

I go to "Prefs" and "LiveView zoom tweaks" and disable 10x, so that only 5x is on. Then I load the raw rec module.

Maybe that's the wrong way...
Title: Re: 550D raw video recording port official thread
Post by: ilguercio on July 25, 2013, 05:07:50 AM
Are you setting LV to be in 5x mode?
I mean, are you magnifying the LV frame?
Title: Re: 550D raw video recording port official thread
Post by: Seb86 on July 25, 2013, 05:09:24 AM
Are you setting LV to be in 5x mode?
I mean, are you magnifying the LV frame?

Oh..now I found out. I have to press the "+" button on the camera. :-D
Title: Re: 550D raw video recording port official thread
Post by: 1024 on July 25, 2013, 02:32:54 PM
i see that moon is very popular these days :)
i've also made a video 2 days ago

1152x384 px @24fps

i used a dobsonian 6" telescope

http://1024times.com/moon.mp4 (http://1024times.com/moon.mp4)

Another test with RAW video. Shot using kit lens 55-250mm, in 5x zoom mode.

720p in 3:1 ratio, recorded at 23.976 fps until buffer filled up. Utilised Auto ETTR to get the most usable data from RAW.

Title: Re: 550D raw video recording port official thread
Post by: tecgen on July 25, 2013, 08:23:45 PM
Hi everybody,

first of all I need to thank the whole Magic Lantern team for their great work. Its quite amazing what you have reached so far. I've got a lot respect for your work.

Today I did some test and shot some small videos from my balcony.


I am very impressed by the results. Now I am thinking about to buy a used 50d only for RAW video :)
Title: Re: 550D raw video recording port official thread
Post by: Soupertrooper on July 26, 2013, 01:03:26 AM
Are we able to do 1280x720 on the 550d?
Title: Re: 550D raw video recording port official thread
Post by: jackdelamare on July 26, 2013, 05:14:30 PM
Hello everyone, long time visitor first time poster.

I have a 550D which I've shot with for many years (most recently this http://www.youtube.com/watch?v=w1W-Vu1wXJs) and I've been loving what the ML team have been doing with raw video as of recently, and amazed that even the 550D has been able to shoot raw.

I'm interested in shooting raw and in fact shot a little test yesterday, but I have a bigger question. I'm about to start production on another music video that's going to be shot in a sunny forest. I want to get the best quality I can (and have the ability to work with a higher dynamic range) and I feel like shooting raw is a wise idea, but I'm worried about a couple of things. Obviously the build is only in alpha stages right now and I noticed I do get the occassional frame drop that stops the recording. The lower resolution I go the less that occurs, but I want at least 1280x720 resolution and I'm worried my 550D won't be able to do this without constant frame dropping and screw-ups on set. I know that I'm going to need a faster SD card but can a faster SD card provide non-stop 720p recording?

What should I do? Is it worth pushing my camera and shooting the video in raw or should I stick to normal shooting? I'm just inexperienced with shooting raw and I wouldn't want anything to go wrong on set while we're trying to film within the allocated time.

Thanks!
Title: Re: 550D raw video recording port official thread
Post by: tecgen on July 26, 2013, 05:31:39 PM
Yes, you can record in HD resolution (1280x720) with the 550d, but continuously only with 12,5 frames per second when your SD card can write the frames fast enough. When you choose a resolution and frame rate combination that exceeds 20MB/s you will get drop outs. But maybe you could buy a Canon EOS 50d. This model should be able to write around 80-90MB/s to an compact flash card.     

PS: Nice & professional looking music video. Good work!

best regards,
Marco
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on July 26, 2013, 10:04:04 PM
Hi to all the Magic Lantern staff, members and readers. I haven't been this excited since my son was born!

Hey jackdelamare, The first thing I would like to say to you is I loved your video. You are an true artist indeed and your last comment inspired me to come hang out with the big dogs!I think, at the moment, Magic Lantern Raw, the t2i and music videos are a really good match. Shoot your video with the t2i because from watching "Twelve Ton Trouble" you will definitely hit a home run!

 So far the best recording mode I found for continuous recording is 960x540, 23.97 16x9 or 2:35. I choose 23.97 because some of the members video use these settings and the videos look very good without having to use Twixtor.

 Two weeks ago I was rendering two minute videos 1280x720 through Premiere or After Effects. They took on average 30-45 minutes per video to render? I am kind of new to both programs, transitioning from Sony Vegas. Two day ago I learned Resolve pink dot removal technique and decided to re-edited three of those videos and rendered them 1920x1080. They did not need titles or credits The rendering time was around five minutes per video. My workflow today is Eyeframe to Resolve. The plan for an upcoming short is to roundtrip with Resolve and CS6

The area I really need help with is the 'best" camera settings (aspect ratio) shooting 960x540 and editing (resizing) footage shot with the Panasonic LA 7200 anamorphic adapter (2;35). So far the best lens I have used that do not need a 0.5 diopter is a 28mm.

I want to thank the Magic Lantern team for providing these awesome updates! If any of you, one or two, not the whole team, come to St. Louis, lunch is on me!
Title: Re: 550D raw video recording port official thread
Post by: Supermac on July 31, 2013, 08:02:27 PM
Hi guys, anyone know if there is a current 550d build with anamorphic preview?

Cheers
Title: Re: 550D raw video recording port official thread
Post by: pooli on August 01, 2013, 02:59:58 PM
Hi guys. My test
I used MEOPTA ANAGON 2X Projection Anamorphic attachment with lens helios 44m on my canon550d
SD card
resolution - 960x540
aspect ratio 16:9
24 fps

1920x540 (3,55:1) on post

(http://s003.radikal.ru/i201/1308/fd/2fc3f049b1f8.jpg)



Title: Re: 550D raw video recording port official thread
Post by: jackdelamare on August 01, 2013, 03:42:42 PM
Yes, you can record in HD resolution (1280x720) with the 550d, but continuously only with 12,5 frames per second when your SD card can write the frames fast enough. When you choose a resolution and frame rate combination that exceeds 20MB/s you will get drop outs. But maybe you could buy a Canon EOS 50d. This model should be able to write around 80-90MB/s to an compact flash card.     

PS: Nice & professional looking music video. Good work!

best regards,
Marco
So basically a 550D's max MB/s is around 20? So it can't be pushed higher than those resolutions, unless you go for a lower fps? And glad you liked my music video, thanks!

Hey jackdelamare, The first thing I would like to say to you is I loved your video. You are an true artist indeed and your last comment inspired me to come hang out with the big dogs!I think, at the moment, Magic Lantern Raw, the t2i and music videos are a really good match. Shoot your video with the t2i because from watching "Twelve Ton Trouble" you will definitely hit a home run!
Thank you so much for your kind comments! You think I should shoot my music video using my 550D in RAW? Or stick to what I know won't cause problems (ie: normal h.264 shooting)? It's difficult. I think I need to get more used to shooting RAW. I went out yesterday and filmed some stuff in RAW and I'm using GingerHDR now to edit it through Premiere. Is this the best method? The workflows I've seen are what I'm dreading the most... GingerHDR seems to have given us the simplest way to edit RAW.
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 01, 2013, 09:33:01 PM
Jack my answer is yes, absolutely! Hey, now, if you have a 5dm3 or 50d, I would say use them first. You probably have already jumped out your editing chair seeing the details of that raw footage from your t2i. You will not get that clarity shooting H.264.

 I am not expecting ML to make any more improvements to our camera. Right now I am more than satisfied. I have two music videos, a short film and some sound bites scheduled the next two weeks. Every one of them will be shot raw with theT2i. Reading viewers comments as they watch raw videos shot with the T2i at 960x540 I can "see' them scratching their head. People can not believe what they are seeing at that resolution. Magic Lantern Rah Rah, Rah Rah Rah!

 Some weird things are happening. I have seen 50+ raw videos and I do not recall hearing natural sounds on one of them. I am "guilty" of this also. I posted two videos without audio and have three more without audio to post. Ha ha ha that's funny! Ambient sound is so needed! And I have two H4N's? No excuse. Some of the music added to the videos is so bad you have to turn it off to enjoy the raw footage.  The other "thing" ML raw is doing to us is turning us into architecture and landscape photographers. People are excited about shooting in their backyards or at their gutters. Where are the humans subjects? There is nothing like details of faces. Ha ha ha... What's good is we see more focus on good composition. That is how excited we are about ML raw!

 My workflow today is Eyeframe to Resolve. That's it. Drop raw files in Eyeframe, set location. In location folder there are dng's and tiffs. Eyeframe then ask you if you want proxies. Import dng's into Resolve. However Resolve introduces pink dots that need removing. This tutorial on pink dot removal is really good! http://www.magiclantern.fm/forum/index.php?topic=6845.0 Adjusting sharpness and blur are very important. I think its sharpness in the top node down to around 6 and blur all the way up in the bottom node.

  My workflow a month ago was raw to raw2dng-After Effects-Adobe Camera Raw for balancing images and color correction. Then render or dynamic link to Premiere. No pink dots to deal with in ACR but ACR default settings add tint and sharpness to the images. I would set sharpness and tint to zero in ACR before image balancing and color grading. Premiere and After Effects are very powerful but as of today the two problems I have are: I have only been using them a month and the rendering times are so slow. A two minute video take 30-40 minute. Same video takes five minutes in Resolve.

 As of tomorrow my workflow will be Resolve round trip with CS6. (render in Resolve) This seven minute video explains the process:http://www.blackmagicuser.net/topic/127-resolve-to-premiere-cs6-adjusting-proxy-settings-for-workflow/

Jack, I hope this helps.
Derrick
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 01, 2013, 10:20:30 PM
Hi guys. My test
I used MEOPTA ANAGON 2X Projection Anamorphic attachment with lens helios 44m on my canon550d
SD card
resolution - 960x540
aspect ratio 16:9
24 fps

1920x540 (3,55:1) on post

(http://s003.radikal.ru/i201/1308/fd/2fc3f049b1f8.jpg)



Pooli you seem to understand anamorphic ratios. Help me out. I am shooting with the T2I 960x540 and 16x9 with a Panasonic LA 7200, that has a 1.33 squeeze factor. If I want the image width to be 1280 or 1920 what size should the height be with the 1.33 squeeze? I'm using CS6 and Resolve. How do I unsqueeze the image in those programs?

In your footage the vertical number 540 did not change but the width did? Maybe, I think I might have something, the squeeze is width only? Then, how do you calculate 3.55:1 x 960 to get 1920? How would I calculate 1.33 x 960 to get 1280 or 1920? I hope my questions are clear.

All is well,
Derrick   
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 01, 2013, 11:57:59 PM
Hi guys. My test
I used MEOPTA ANAGON 2X Projection Anamorphic attachment with lens helios 44m on my canon550d
SD card
resolution - 960x540
aspect ratio 16:9
24 fps

1920x540 (3,55:1) on post


WOW ! Very interested ! Can you tell how you connected the anamorphic lens to the helios lens and then to 550D ? Can you post photos of the overall look and photos of particulars on how they are hooked up ? Many thanks !
Title: Re: 550D raw video recording port official thread
Post by: pooli on August 02, 2013, 12:28:50 AM
(http://i080.radikal.ru/1307/2d/5c071eee0807.jpg)
(http://s14.radikal.ru/i187/1307/c4/f348618658c6.jpg)
Title: Re: 550D raw video recording port official thread
Post by: pooli on August 02, 2013, 12:47:42 AM
Quote
Pooli you seem to understand anamorphic ratios. Help me out. I am shooting with the T2I 960x540 and 16x9 with a Panasonic LA 7200, that has a 1.33 squeeze factor. If I want the image width to be 1280 or 1920 what size should the height be with the 1.33 squeeze? I'm using CS6 and Resolve. How do I unsqueeze the image in those programs?

In your footage the vertical number 540 did not change but the width did? Maybe, I think I might have something, the squeeze is width only? Then, how do you calculate 3.55:1 x 960 to get 1920? How would I calculate 1.33 x 960 to get 1280 or 1920? I hope my questions are clear.

All is well,
Derrick
   
If you anamorphic factor of 1,33х you can get a 2.35:1 video . For example, if you have a height of 960, then it turns out to 2.35 x 960 = 2256 your frame width. I hope I understand you correctly.
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 02, 2013, 04:22:28 AM
   
If you anamorphic factor of 1,33х you can get a 2.35:1 video . For example, if you have a height of 960, then it turns out to 2.35 x 960 = 2256 your frame width. I hope I understand you correctly.

Yes and thanks! I now understand the width part. Is the height calculated the same way? If the answer is yes the 960 x 540 unsqueezed image will be 2256 x 1269? If the answer is no please explain the height part. And lastly how do you crop it down to a 1920 or 1280 width? Pooli I really appreciate your help.

Best wishes,
Derrick

Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 02, 2013, 08:34:59 AM
Yes and thanks! I now understand the width part. Is the height calculated the same way?

Best wishes,
Derrick

Anamorphic means no-morphic, so not keeping the original shape. Only one dimension is squeezed, normally horizontal one. So height is not at all affected. This is the beauty and the main characteristic of anamorphic lens.
Title: Re: 550D raw video recording port official thread
Post by: pooli on August 02, 2013, 10:04:35 AM
Anamorphic means no-morphic, so not keeping the original shape. Only one dimension is squeezed, normally horizontal one. So height is not at all affected. This is the beauty and the main characteristic of anamorphic lens.
   
Yes, it's so
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 02, 2013, 06:40:53 PM
Anamorphic means no-morphic, so not keeping the original shape. Only one dimension is squeezed, normally horizontal one. So height is not at all affected. This is the beauty and the main characteristic of anamorphic lens.

Wow! Thanks Pooli and dlrpgmsvc for clearing this up. Now I can properly introduce the LA 7200 to Magic Lantern!

God Bless,
Derrick
Title: Re: 550D raw video recording port official thread
Post by: dafassi on August 04, 2013, 11:30:29 PM
Hi! Im very new to RAW recording with the eos 550d.

Could you please tell me, what version and what additional files are need to get the MAX record size with best FPS?
I was reading things about variable rates.

What is the best size/fps we can have for NOW with the eos550D ?
Title: Re: 550D raw video recording port official thread
Post by: ItsMeLenny on August 05, 2013, 12:36:54 PM
(Just tried Raw for the first time)

With the build I had it worked fine. <-- 23rd JULY

Upgraded to the latest auto build, every single frame was pink, of the 170. <-- 5th AUG
Title: Re: 550D raw video recording port official thread
Post by: cwebb4 on August 05, 2013, 10:53:01 PM
Can anyone comment on what is reasonably usable resolution wise on the 550d, say around 10 seconds. I understand that max continuous resolution is 960x540, is this really comparable sharpness and resolution wise to the 1080 h264, would those of you that have used and compared it opt for the 550 RAW over the h264?

I am considering shooting a project in RAW and could probably manage with 10-12 second bursts, what are we looking at roughly, for a 2.35 or 16x9 finish, i was thinking 1200x500 maybe?
Title: Re: 550D raw video recording port official thread
Post by: blazraidr on August 06, 2013, 03:12:21 AM
Can anyone comment on what is reasonably usable resolution wise on the 550d, say around 10 seconds. I understand that max continuous resolution is 960x540, is this really comparable sharpness and resolution wise to the 1080 h264, would those of you that have used and compared it opt for the 550 RAW over the h264?

I am considering shooting a project in RAW and could probably manage with 10-12 second bursts, what are we looking at roughly, for a 2.35 or 16x9 finish, i was thinking 1200x500 maybe?

I can get 1280x426 for about 40 seconds without any skipped frames. I'm not completely sure which build I have though, it's one of the older ones, MemFixAll iirc.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 06, 2013, 09:52:22 AM
Can anyone comment on what is reasonably usable resolution wise on the 550d, say around 10 seconds. I understand that max continuous resolution is 960x540, is this really comparable sharpness and resolution wise to the 1080 h264, would those of you that have used and compared it opt for the 550 RAW over the h264?

I am considering shooting a project in RAW and could probably manage with 10-12 second bursts, what are we looking at roughly, for a 2.35 or 16x9 finish, i was thinking 1200x500 maybe?

1200x500 is ok for 500+ frames = 21 sec at 24 fps
Title: Re: 550D raw video recording port official thread
Post by: dafassi on August 06, 2013, 10:24:06 PM
By the way ... ReWind ... extreme finde hack-version! works well on my 550d!
in post the quality is amazing ... still one question.

i shot in 1472x420@24fps (canon set to 720p/50fps).
Scaling it up to HD (ie 1280x720) looks fantastic!

How do i have to export (codec?) without loosing the quality?
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 08, 2013, 08:02:11 AM
So basically a 550D's max MB/s is around 20? So it can't be pushed higher than those resolutions, unless you go for a lower fps? And glad you liked my music video, thanks!
Thank you so much for your kind comments! You think I should shoot my music video using my 550D in RAW? Or stick to what I know won't cause problems (ie: normal h.264 shooting)? It's difficult. I think I need to get more used to shooting RAW. I went out yesterday and filmed some stuff in RAW and I'm using GingerHDR now to edit it through Premiere. Is this the best method? The workflows I've seen are what I'm dreading the most... GingerHDR seems to have given us the simplest way to edit RAW.

Jack I was thinking about you today after shooting 90% of a short film. The director agreed to shoot it in raw and with the Panasonic LA 7200 anamorphic adapter, using a vintage Cosina 28mm lens. The lens and adapter worked so well together! I've been telling Alex that  I am not a fan of blown out highlights that are in most movies today? Two of my challenges were focus and capturing details in all the shots.  Every scene was shot outside today, most with ND filters because the LA 7200 works best when the taking lens is at 5.6.

 We filled four 8gb cards, one 16gb card and half of another 16gb card. The biggest problem was with the only Kingston card. The 8gb class 10 card could only record between 235 - 400 frames per take before stopping. The three Scandisk 8gb cards recorded continuously even thought two of them are old class 6 cards bought in 2010 when I purchased the T2i. I think the Kingston card writes at only around 15mb per second. My year old Micro Center 16gb card recorded at most 400 frames per take but the new Micro Center 16gb card Alex purchased yesterday recorded around 1200 frames per take? I'm saying all this to say, most class 10 cards write too slow to record raw continuously at 960 x 540. Make sure your cards write faster than 21mb per second!

Even with the cards slowing down production I am looking forward to finishing the film in raw. I will post some footage by this weekend.

Happy shooting,
Derrick
Title: Re: 550D raw video recording port official thread
Post by: Tahvero on August 09, 2013, 11:58:04 AM
I am using unified nightly version of ML in my 550D and noticed that 1024 resolution is missing from menu. I read this thread and see that many people have used that resolution with some other build. It would be nice to have it also in unified nightly so more people could try it (Including me  :) ).
Title: Re: 550D raw video recording port official thread
Post by: truemoscow on August 13, 2013, 09:09:32 AM
My small video. 550D 1200x400 25fps daylight upscaled to 1080p. Sandisc pro Extreme 95mbit, MK11174 June 26.
Title: Re: 550D raw video recording port official thread
Post by: pooli on August 13, 2013, 12:44:51 PM
Dual ISO for 550d possible?
Title: Re: 550D raw video recording port official thread
Post by: glubber on August 13, 2013, 01:33:09 PM
Dual ISO for 550d possible?

Not yet...only 5D/6D/ 7D and 50D can do Dual-ISO at the moment.

http://www.magiclantern.fm/forum/index.php?topic=7139.msg59687#msg59687 (http://www.magiclantern.fm/forum/index.php?topic=7139.msg59687#msg59687)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 13, 2013, 03:21:48 PM
Dual ISO for 550d possible?

Unfortunately not, 550D lacks the necessary hardware inside her...  :'(
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 13, 2013, 06:22:07 PM
My small video. 550D 1200x400 25fps daylight upscaled to 1080p. Sandisc pro Extreme 95mbit, MK11174 June 26.

Very nice! Did you shoot 5x crop, which lens, how many frames captured per clip? Thanks for sharing.

Welcome to the forum!

Derrick
Title: Re: 550D raw video recording port official thread
Post by: 1% on August 13, 2013, 06:30:13 PM
You can probably do dual ISO. Maybe not in LV but at least in photo. If 50D can do it...
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on August 14, 2013, 08:17:28 AM
How would we accomplish that?
It is as simple as downloading the 50D tragic lantern zip and then maybe sym file to the 550D one?
Or would it still have to be compiled in some form or fashion?

Would a 7D make more sense?
(I'm unsure if you were just making a point with the 50D as it had less capabilities).
I'd almost be willing to test...it's just a matter of determining how :)
Title: Re: 550D raw video recording port official thread
Post by: truemoscow on August 14, 2013, 08:31:34 AM
Very nice! Did you shoot 5x crop, which lens, how many frames captured per clip? Thanks for sharing.
Welcome to the forum!
Derrick
Thanks Derrick! 1200x400, 3:1 crop, 24-105mm f/4L zoom lens ~ 70mm.
Continuous rec without stopping... about four-five minutes, file size ~ 6,5 GB (system is exFAT).
Congratulations for us! :)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 14, 2013, 12:08:01 PM
How would we accomplish that?
It is as simple as downloading the 50D tragic lantern zip and then maybe sym file to the 550D one?

I don't think that will work, looks like there are certain addresses that need to be found first for our camera and added to the module code.
Title: Re: 550D raw video recording port official thread
Post by: CFP on August 14, 2013, 01:00:27 PM
1% got Dual-ISO working on the 600D. For stills it is really nice.

The 550D will probably have Dual-ISO since it has the same sensor :D
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 14, 2013, 02:00:51 PM
I don't think that will work, looks like there are certain addresses that need to be found first for our camera and added to the module code.

These are the ADTG and CMOS values for 550D (tested and ok) :

#define ADTG_WRITE_FUNC   0xff27ee34
#define CMOS_WRITE_FUNC   0xff27f028
#define CMOS16_WRITE_FUNC 0
#define CARTRIDGE_WRITE_FUNC 0

Do someone has time to compile ?  ;)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 14, 2013, 02:12:14 PM
These are the ADTG and CMOS values for 550D (tested and ok) :

#define ADTG_WRITE_FUNC   0xff27ee34
#define CMOS_WRITE_FUNC   0xff27f028
#define CMOS16_WRITE_FUNC 0
#define CARTRIDGE_WRITE_FUNC 0

Do someone has time to compile ?  ;)
These are the addresses it looks like we need to find.
        FRAME_CMOS_ISO_START = 0x406957C8; // CMOS register 0000 - for LiveView, ISO 100 (check in movie mode, not photo!)
        PHOTO_CMOS_ISO_START = 0x4069464C; // CMOS register 0000 - for photo mode, ISO 100
Title: Re: 550D raw video recording port official thread
Post by: jackdelamare on August 15, 2013, 01:36:33 PM
Jack my answer is yes, absolutely! Hey, now, if you have a 5dm3 or 50d, I would say use them first. You probably have already jumped out your editing chair seeing the details of that raw footage from your t2i. You will not get that clarity shooting H.264.

 I am not expecting ML to make any more improvements to our camera. Right now I am more than satisfied. I have two music videos, a short film and some sound bites scheduled the next two weeks. Every one of them will be shot raw with theT2i.

Jack, I hope this helps.
Derrick
This really does help, and I can't wait to see your music videos and the short film shot on the 550D RAW. Really eager to see.

Jack I was thinking about you today after shooting 90% of a short film. The director agreed to shoot it in raw and with the Panasonic LA 7200 anamorphic adapter, using a vintage Cosina 28mm lens. The lens and adapter worked so well together! I've been telling Alex that  I am not a fan of blown out highlights that are in most movies today? Two of my challenges were focus and capturing details in all the shots.  Every scene was shot outside today, most with ND filters because the LA 7200 works best when the taking lens is at 5.6.

 We filled four 8gb cards, one 16gb card and half of another 16gb card. The biggest problem was with the only Kingston card. The 8gb class 10 card could only record between 235 - 400 frames per take before stopping. The three Scandisk 8gb cards recorded continuously even thought two of them are old class 6 cards bought in 2010 when I purchased the T2i. I think the Kingston card writes at only around 15mb per second. My year old Micro Center 16gb card recorded at most 400 frames per take but the new Micro Center 16gb card Alex purchased yesterday recorded around 1200 frames per take? I'm saying all this to say, most class 10 cards write too slow to record raw continuously at 960 x 540. Make sure your cards write faster than 21mb per second!

Even with the cards slowing down production I am looking forward to finishing the film in raw. I will post some footage by this weekend.

Happy shooting,
Derrick

Derrick, can't wait to see what you've shot. The question is, does a workflow lose quality? I used Ginger HDR on some stuff I shot recently and honestly I am having a little bit of a tough time seeing the difference. Which made me a bit disappointed. But I'm thinking maybe that's because of GingerHDR importing directly into Premiere? I'll post the video unlisted shortly so you can see.

Thanks!
Title: Re: 550D raw video recording port official thread
Post by: truemoscow on August 15, 2013, 02:57:15 PM
Digital Skater Dolly small test. Funny function  :)
550D ML_MK11174_June_26 1200x400 (3:1 crop) 25fps upscaled to 1080p.
Title: Re: 550D raw video recording port official thread
Post by: jackdelamare on August 15, 2013, 10:55:01 PM
https://www.youtube.com/watch?v=f23UFqiYjfQ

Here's my little test, unlisted on YouTube. RAW certainly has given better colour but I am finding it hard to see much of a difference. Is it just me? I used Ginger HDR.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on August 16, 2013, 01:37:13 AM
It might be just you :)
The color shouldn't matter because raw is raw. Nothing is baked in like with the h264 compression and any picture style that you are using.

In other words, you can make them look identical color-wise. In fact, you probably could have adjusted the exposture on the raw on that video - it was a little dark.

Check out my video - you can definitively see the difference. especially on the fishbowl.

Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 16, 2013, 05:42:26 AM
This really does help, and I can't wait to see your music videos and the short film shot on the 550D RAW. Really eager to see.

Derrick, can't wait to see what you've shot. The question is, does a workflow lose quality? I used Ginger HDR on some stuff I shot recently and honestly I am having a little bit of a tough time seeing the difference. Which made me a bit disappointed. But I'm thinking maybe that's because of GingerHDR importing directly into Premiere? I'll post the video unlisted shortly so you can see.

Thanks!


[/quote]
Code: [Select]
http://youtu.be/a5TtDB6-h30
Jack I did add some color and contrast to the video but no sharpness. I did have more blue and details in the sky in another clip in Resolve but the anamorphic framing was not right so I started over in AE.I should have used a closeup of him on the bench, because he's a little soft. We have two more scenes to shoot before this movie is in the can. The DN x HD file from AE is 5gb. This Quicktime file is 745mb.

http://www.youtube.com/watch?v=a5TtDB6-h30&feature=youtu.be

 I could not add the audio track because I did not get from the director and he's out of town until this weekend. I don't think I have seen one raw video and heard its ambiance soundtrack? I will start using the waveform and vectorscopes in Resolve from now on.

 We shot the final scenes of another short film a month ago in H.264. Why? Because we shot the other scenes a year ago and I was really new to raw so, looking back, I think I played it safe. Ha ha ha.. I should have that footage this weekend. I'll upload a scene to show the difference between H.264 and raw.

 Ginger HDR is awesome because you can drop raw files straight into AE/PP and you save hard drive space by not needing dng's or tiffs. If you can't "see the difference" with how it handle the colors try AE or Resolve for that part of the workflow. I have not used it yet but can say Ginger is worth the price because the two things mentioned above. Unless there is a free program that does what it do...
 
  More time is needed using the raw workflow but the results are well worth it.

Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 16, 2013, 09:49:41 AM
Guys, can someone take a look at my raw clip from 550d and tell me why I have so much noise in the shadows? It's shot at ISO 100. .. shouldn't it be much cleaner?

http://l.bitcasa.com/NMFbpUaL

And I also have another question: is it possible to enable black bars in the official build? Rewind's build is nice, but I want all the features of the official build as well...



Title: Re: 550D raw video recording port official thread
Post by: ItsMeLenny on August 16, 2013, 12:35:46 PM
Guys, can someone take a look at my raw clip from 550d and tell me why I have so much noise in the shadows? It's shot at ISO 100. .. shouldn't it be much cleaner?

Did you ETTR (expose to the right)?
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 16, 2013, 12:43:41 PM
mm, I don't think so

here's a frame with ETTR. Does not look much better :(

http://l.bitcasa.com/9K6i7-TX
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 16, 2013, 07:27:59 PM
Anyone with a 550D able to find the correct addresses for Dual Iso so we can test it out, I will compile it if needed, but we need someone that  knows how to find the addresses we need. If it works on the 600D you would think we can get it going too!

These are the addresses it looks like we need to find. These lines are from 1% 600D code but I have no clue how to find the addresses 8[ I only know how to mess with the code and compile it.
        FRAME_CMOS_ISO_START = 0x406957C8; // CMOS register 0000 - for LiveView, ISO 100 (check in movie mode, not photo!)
        PHOTO_CMOS_ISO_START = 0x4069464C; // CMOS register 0000 - for photo mode, ISO 100
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 18, 2013, 08:14:51 AM
Anyone with a 550D able to find the correct addresses for Dual Iso so we can test it out, I will compile it if needed, but we need someone that  knows how to find the addresses we need. If it works on the 600D you would think we can get it going too!

These are the addresses it looks like we need to find. These lines are from 1% 600D code but I have no clue how to find the addresses 8[ I only know how to mess with the code and compile it.
        FRAME_CMOS_ISO_START = 0x406957C8; // CMOS register 0000 - for LiveView, ISO 100 (check in movie mode, not photo!)
        PHOTO_CMOS_ISO_START = 0x4069464C; // CMOS register 0000 - for photo mode, ISO 100

Shouldn't you be able to simply use CTRL/CMD + F?

also, I've been playing with RAW and, though the 'official' spec is 960X540, I'm currently playing with footage that was shot at 1280X344. Still messing with parameters so either tomorrow or Monday I should have some footage/a tutorial
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 18, 2013, 05:26:02 PM
Here's my experiment with unscaled 1720x728 @ 20fps . I manage to capture around 54-59 frames per take. Looks very nice!


Processed with Rawtherapee and encoded with ffmpeg/x264
Title: Re: 550D raw video recording port official thread
Post by: mohanohi on August 18, 2013, 05:50:06 PM
mm, I don't think so

here's a frame with ETTR. Does not look much better :(

http://l.bitcasa.com/9K6i7-TX

your expose isn't correct. Spot meter with your camera and +1 stop you will get good exposure in this particular shot. IMO ETTR does expose by taking everything in the frame. And hence your problem. Or get a light meter and expose properly. You won't get any noise in the shadow.
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 18, 2013, 05:55:12 PM
thanks! I read up on ETTR and indeed, it makes a huge difference
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 19, 2013, 02:56:19 PM
Here is some RAW video tests I threw togethe to show off the higher resolution you can get (Higher than the 'official' spec at least) with continuous recording:

http://www.youtube.com/watch?v=VNfVeQVt8HI&feature=youtu.be

not perfect (Far from it), but it should give you an idea.

Here is how it worked:

1: Have a very past card. at least 133X.
2: go to 720P mode
3: turn on FPS override and set it to 23.98
4: start at a low resolution (like 960X540)
5: work your way UP to 1280 at 2/35 (1280X388)
6: Boom! continuous recording at 1280X581!

EDIT: Very important note: This dies not need to be done for each clip, only when you first insert the card (Or if it crashes).

I don't know if this needs to be done with each, individual, card, since I only have one card that can handle the data loads ha ha
Title: Re: 550D raw video recording port official thread
Post by: CFP on August 19, 2013, 05:37:10 PM
Here is some RAW video tests I threw together
No offense but this comparison video seems quite pointless ;D

I mean, it is supposed to show ... what exactly? In this test, it looks like the squished 1280 X 388 RAW videos would be better than regular 1920 X 1080 H.264 videos in terms of sharpness and detail. And that's just not the the case. Why did you downscale the H.264 footage? And why did you bulred it so hard? Why is the field of view so different in many shots? Did you crop the video, or did you actually changed the focal length?

I don't want to say that the comparison is horrible. But you should tell us exactly what we are seeing and what it is supposed to show.
That would make the video more interesting and helpfull.

By the way, if you film in the squished 720p mode, be carefull. It can give way worse aliasing than the unquished modes.
I would use it only if I needed a really shallow depth of field.
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 19, 2013, 06:07:44 PM
No offense but this comparison video seems quite pointless ;D

I mean, it is supposed to show ... what exactly? In this test, it looks like the squished 1280 X 388 RAW videos would be better than regular 1920 X 1080 H.264 videos in terms of sharpness and detail. And that's just not the the case. Why did you downscale the H.264 footage? And why did you bulred it so hard? Why is the field of view so different in many shots? Did you crop the video, or did you actually changed the focal length?

I don't want to say that the comparison is horrible. But you should tell us exactly what we are seeing and what it is supposed to show.
That would make the video more interesting and helpfull.

By the way, if you film in the squished 720p mode, be carefull. It can give way worse aliasing than the unquished modes.
I would use it only if I needed a really shallow depth of field.

I downrezzed the 1080, mainly, to give it a bit of a chance. It looked horrendous when kept at 100% and, for web delivery, 720P is very common, so I decided that a downres would make the most sense.

I was filming in the squished 720P, there IS more aliasing/moire, but it is something I can definitely deal with for the extra detail in everything else. (Reolution baby!)

Some of the shots are not identical as I changed focal lengths to try and account for the crop that happens when filming RAW like this and, frankly, did my math wrong. (This is brought up in the youtube video description ;) ) Oops?

The 720P mode needs much less data, so you can get more resolution out of it, compared to 1080P which limits you to near standard-def.

 
Title: Re: 550D raw video recording port official thread
Post by: Nachelsoul on August 19, 2013, 08:29:13 PM
Hi guys, I´m a little lost. Where I can find the newest builds (nightly) fot the 550D?. I scrolled the forum and the last I found is Rewind's 21/6. Thanks.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 19, 2013, 09:09:17 PM
Hi guys, I´m a little lost. Where I can find the newest builds (nightly) fot the 550D?. I scrolled the forum and the last I found is Rewind's 21/6. Thanks.

The nightly builds are only for the unified (no raw video module). If you want the latest nightly build with raw video inside it, you must compile yourself and take the latest raw module to add.
Title: Re: 550D raw video recording port official thread
Post by: Nachelsoul on August 19, 2013, 09:26:40 PM
The nightly builds are only for the unified (no raw video module). If you want the latest nightly build with raw video inside it, you must compile yourself and take the latest raw module to add.
Thanks dude.
Title: Re: 550D raw video recording port official thread
Post by: Fringuello on August 20, 2013, 02:16:01 AM
Il mio test
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 20, 2013, 11:57:27 AM
The nightly builds are only for the unified (no raw video module). If you want the latest nightly build with raw video inside it, you must compile yourself and take the latest raw module to add.

I think you are wrong. I use nightly builds with 550d all the time and raw is enabled there. http://nanomad.magiclantern.fm/nightly/
Title: Re: 550D raw video recording port official thread
Post by: glubber on August 20, 2013, 02:42:07 PM
I think you are wrong. I use nightly builds with 550d all the time and raw is enabled there. http://nanomad.magiclantern.fm/nightly/

My latest ML is v2.3.NEXT.2013Jul15.550D109 Mercurial changeset : aa2ba85342fa (unified) tip Built on 2013-07-15 02:14:26 by nanomad@magiclantern.fm and i recorded some RAW-Videos with it.

@dlrpgmsvc: it would be interesting, if your own builds are better than the unified (although i guess the ingredients must be mostly the same)

I guess the confusing thing is:
Since the unified-nightlies don't contain RAW (nor ML itself) for the 5DIII  - and most RAW-talk is about the 5DIII -  there are a lot of post on the forum and the web about getting the ML-firmware from NON-nightly builds.

And it says in the Nightly thread (http://www.magiclantern.fm/forum/index.php?topic=3072.0): Nightly Builds - try the very latest stuff here -NOT FOR RAW

I'm reading the forum on a daily basis, but i'm doing real hard keeping up to date :P
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 20, 2013, 03:29:37 PM
Glubber, can you upload those videos and what specifics do you like about that nightly build from 7-15-2013?
Title: Re: 550D raw video recording port official thread
Post by: glubber on August 20, 2013, 04:01:38 PM
Oh sorry, i guess i didn't express myself right...my skills in english are not the best.

I did not want to claim that the 15-july-build is the best one for 550D.
It's just the latest one i put in my camera. I just wanted to confirm pavelpp's post above.

Btw. i'm still working on my first Video to upload.   ;D
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on August 23, 2013, 07:34:22 AM
Sorry for RAW noob Question, but we do have to shoot x5 zoom don't we? To get rid of all the false colors etc. and have sharp shots. Is that right?
As all my regular un-zoomed shots are sparkly crap :(
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on August 23, 2013, 09:36:23 AM
hi 3point, I believe 5x zoom is 1:1 crop out of non line skipped source and non 5x is a crop out of 1920x1080 line skipped source but line skipped is still generally more detail, sharper and uncompressed compared to h264. 5x zoom you'll need to be rock steady.

As for false color and all that, so much is down to interpretation of the raw source via whatever raw development tool is used that its not necessarily in the camera raw source but via crap raw dev process.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on August 23, 2013, 09:58:50 AM
Thanks y3llow, yeah I'm cheating with TIFFs from the new portable (love that) app at http://www.magiclantern.fm/forum/index.php?topic=7825.0 but I gather that the developing is a bit simple? Thanks for the tip, I will ask the developer what process is going on under the hood.
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on August 23, 2013, 02:44:38 PM
The portable app is over the top for raw2tiff, dcraw will do it and with a lot more control. That app is really to cater for 600D & 650D's that dcraw supposedly doesn't like or if you want demosaiced raws that retain the ability to adjust WB etc ie: linear DNG for reasons such as Resolves crap demosaic of Canon raw.

Don't know what that app puts out in way of tiff but dcraw will give you 16bit open gamut linear RGB tiffs using any of a number of demosaicing algos, various color spaces gamma encoded if you wish.

libraw is another very useful raw library that emulates dcraw. dcraw-float another. Or ufraw on the CLI all depending what you want to bake into the tiffs.

A simple 5 line batch script will process a folder full of raws and give you tiffs and proxy DNxHD or Prores etc via ffmpeg

Don't get me wrong though the portable app like all the other DNG output batch converters have a use if you want to stay 'raw' or 'sorta raw' in the case of Force 'Linear' but for tiffs better options exist.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on August 23, 2013, 03:29:00 PM
Oh so dcraw will decompress an ML RAW file (image sequence)? I can use dcraw as portable app or install? Any good places to find a brief how too then?
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on August 23, 2013, 03:58:02 PM
No, its a two step, raw2DNG app and then dcraw does DNG2tif but if done in a simple script you can delete the DNGs as tifs are created.

So yes the app does raw2tif great but at what cost to control. It crashes for me on Linux but worth testing output from dcraw versus the app.

If going to tiff or exr or prores etc I'd rather a two step with control over WB, sensor saturation point, channel clipping handling, demosaic algo, gamma or linear, black point, whether to normalize stretch 14bit levels into 16bit or not, highlight recovery stategy and possibly omit dcraw and go to tiff via ufraw with logish flat preset applied.

http://www.guillermoluijk.com/tutorial/dcraw/index_en.htm (http://www.guillermoluijk.com/tutorial/dcraw/index_en.htm)

http://www.libraw.org/docs/Samples-LibRaw-eng.html (http://www.libraw.org/docs/Samples-LibRaw-eng.html)

http://ninedegreesbelow.com/photography/dcraw-float-command-line-options.html (http://ninedegreesbelow.com/photography/dcraw-float-command-line-options.html)
Title: Re: 550D raw video recording port official thread
Post by: glubber on August 24, 2013, 08:29:41 AM
Just a little hint if you want to use DCRAW.
The raw  converter Rawanizer has a built-in GUI for dcraw.

"Instead of lightroom, in RAWanizer I hit custom button which brings up a dialog for making settings for dcraw conversion. Tweak the settings and hit save. This is now the settings use for conversions. If I'm satisfied with the quality I choose to use a high quality codec and hit start. Now I have a file ready for my NLE"
Title: Re: 550D raw video recording port official thread
Post by: deleted.account on August 24, 2013, 12:26:21 PM
Just a little hint if you want to use DCRAW.
The raw  converter Rawanizer has a built-in GUI for dcraw.

Yep and...

Quote
Only works on windows

Yet it...

Quote
is using raw2dng, dcraw and ffmpeg.

Where as this 8 line script, like many scripts on the forums here is portable, doesn't need installing any component or libraries, uses the same three apps (raw2dng, dcraw and ffmpeg), can be tweaked and extended without a whole development / compiling / recompiling cycle and setup, using nonsense proprietary OS specific development environment & libraries for a freaking batch converter and the script is pretty universal apart from syntax:

Quote
for file in *.RAW ; do
mkdir './Out/'$file'/'
wine ./raw2dng.exe $file './Out/'$file'/'
mkdir './Out/'$file'/yuv16'
   for out in "./Out/$file/*.dng" ; do
      dcraw -c -a -H 1 -o 1 -q 3 $out | ffmpeg -f image2pipe -vcodec ppm -r 24000/1001 -s 1152x482 -i - -f mov -vcodec prores -profile:v 2 -pix_fmt yuv422p10le -r 24000/1001 "./Out/$file/yuv16/$file.mov"
   done
done

Of coarse it's not as pretty, or has a GUI and may cause mac users a bit of trouble, :-)jk and no disrespect to RAWanzier or it's dev, who is providing a free tool which works for many and built in an application environment he/she knows well.
Title: Re: 550D raw video recording port official thread
Post by: Vilnius1998 on August 24, 2013, 01:00:43 PM
I have been able to manage to record 1728x648 for 60 frames instead of 24.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 24, 2013, 01:15:01 PM
I have been able to manage to record 1728x648 for 60 frames instead of 24.
I've just got 58 frames 1728x692 @23.976 fps
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 25, 2013, 04:15:39 AM
Dual ISO seems to be working in PhotoMode on 550D

//  00 0000 406941E4  = 100
//  00 0024 406941F6  = 200
//  00 0048 40694208  = 400
//  00 006C 4069421A  = 800
//  00 0090 4069422C  = 1600
//  00 00B4 4069423E  = 3200

        PHOTO_CMOS_ISO_START = 0x406941E4; // CMOS register 0000 - for photo mode, ISO 100
        PHOTO_CMOS_ISO_COUNT =          6; // from ISO 100 to 3200
        PHOTO_CMOS_ISO_SIZE  =         18; // distance between ISO 100 and ISO 200 addresses, in bytes

http://www.mediafire.com/download/r32p2hsc9n83y2q/ML_550D_Dual_ISO_Aug_25_2013.zip

I get an interlaced looking image, when I run it through cr2hdr.exe I get a dng, maybe others can test to see if it really does anything?

I tried for Live View Info but I get crash when turning on ADTG module from Tragic-Lantern while in Live View, and I don't know how to look at the ATDG.BIN.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 25, 2013, 09:19:18 AM
Yes, it works. Congratulations, brotherhood! )

Examples below are from my first extreme test. Exposure pushed up in ACR all the way up to +5 f-stops.
First crop is from usual iso 100 cr2, second from dual iso 100-1600 dng processed with cr2hdr.exe

(http://moredo.ru/raw/dualisoTest1_iso100.jpg)
(http://moredo.ru/raw/dualisoTest1_iso100-1600.jpg)
(exactly the same settings for both, no any noise reduction)
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 25, 2013, 09:29:31 AM
Guys, I can't find where to download the cr2hdr.exe from
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 25, 2013, 09:36:15 AM
Guys, I can't find where to download the cr2hdr.exe from
http://www.magiclantern.fm/forum/index.php?topic=7139.0
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 25, 2013, 09:45:44 AM
I got Live View going with Dual ISO it looks like.

At first I was not sure it worked till after I used RAW2DNG on the RAW then I dragged the DNG's onto the CR2HDR.exe and it modified the interlaced ones correctly.

http://www.mediafire.com/download/kjj8ddkkfmge8vz/ML_550D_Dual_ISO_Aug_25_2013_Update.zip

by the way, here is address for Live View

        FRAME_CMOS_ISO_START = 0x40695494; // CMOS register 0000 - for LiveView, ISO 100 (check in movie mode, not photo!)
        FRAME_CMOS_ISO_COUNT =          6; // from ISO 100 to 3200
        FRAME_CMOS_ISO_SIZE  =         30; // distance between ISO 100 and ISO 200 addresses, in bytes
Title: Re: 550D необработанные записи видео порт официальный нить
Post by: pooli on August 25, 2013, 10:42:45 AM
I do not understand how to properly work with the cr2hdr.exe?  :(
I drag file .DNG(made using raw2dng of .RAW) on cr2hdr.exe- nothing happens!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 25, 2013, 10:46:19 AM
Quote
At first I was not sure it worked till after I used RAW2DNG on the RAW then I dragged the DNG's onto the CR2HDR.exe and it modified the interlaced ones correctly.

Now one can process dual iso video just with new raw2dng. It combines dual exposures automatically right from raw file and gives the ready dng's at output.
Check the first post in this thread: http://www.magiclantern.fm/forum/index.php?topic=7139.0
There is a link to the latest raw2dng at the postprocessing section.
Title: Re: 550D необработанные записи видео порт официальный нить
Post by: Rewind on August 25, 2013, 10:47:14 AM
I do not understand how to properly work with the cr2hdr.exe?  :(
I drag file .DNG(made using raw2dng of .RAW) on cr2hdr.exe- nothing happens!

cr2hdr is for cr2 files, as its name says )
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 25, 2013, 10:53:44 AM
Now one can process dual iso video just with new raw2dng. It combines dual exposures automatically right from raw file and gives the ready dng's at output.
Check the first post in this thread: http://www.magiclantern.fm/forum/index.php?topic=7139.0
There is a link to the latest raw2dng at the postprocessing section.
I know  :) I was trying to process it wrong at first but figured it out not to long after, I was just excited after finally finding the address I did not take time to process it correctly but in the end I got my Raw video processed correctly.  ;)
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 25, 2013, 11:00:30 AM
Quote
I was just excited after finally finding the address...
Wish I could shake your hand, man.
Title: Re: 550D необработанные записи видео порт официальный нить
Post by: mk11174 on August 25, 2013, 11:01:17 AM
I do not understand how to properly work with the cr2hdr.exe?  :(
I drag file .DNG(made using raw2dng of .RAW) on cr2hdr.exe- nothing happens!
Maybe it is the version I use, but for me, I used RAW2DNG to extract my RAW file, I then got Interlaced DNG's then I just selected all the DNG's and dragged them onto the CR2HDR and then I was left with normal looking DNG's that I was able to adjust more dynamically, so this way worked for me.

As for the CR2 stills, I just simply dragged them onto the cr2hdr file, I am using windows version by the way.

Here are the versions I am using.

http://www.mediafire.com/download/j93ojwx50ddv201/Raw2DNG_cr2hdr_550D_Windows.zip

Oh! One important thing, make sure your CR2 or DNG files that you plan to convert are in same folder as the CR2HDR.EXE file or maybe just use simple folder names, I dont think the long folder names work very well when it comes to drag and drop process. Have not tested yet, but I just put my DNG and CR2 files in the folder with CR2HDR.EXE file till it processed them.

Update! Scratch what I said about having to drag the DNG on the CR2HDR.EXE I must of been seeing things earlier cause now that its lighter out I can test more and just dragging the RAW file onto the RAW2DNG.exe I am using I am getting a normal image now and when it is processing I see its working correctly and the DNG files are very dynamic as they were before in my test but I swore the DNG came out interlaced, so Pardon me for my mess up, I must of been viewing a CR2 at the time LOL.
Title: Re: 550D необработанные записи видео порт официальный нить
Post by: pooli on August 25, 2013, 02:05:13 PM
Oh! One important thing, make sure your CR2 or DNG files that you plan to convert are in same folder as the CR2HDR.EXE file or maybe just use simple folder names, I dont think the long folder names work very well when it comes to drag and drop process. Have not tested yet, but I just put my DNG and CR2 files in the folder with CR2HDR.EXE file till it processed them.
   
Yes, the problem was in this! Thank you. :)
Title: Re: 550D raw video recording port official thread
Post by: dirty_dollar on August 25, 2013, 03:26:44 PM
i have a sd card speed 6 can i shoot a raw on it ?
Title: Re: 550D необработанные записи видео порт официальный нить
Post by: glubber on August 25, 2013, 04:23:01 PM
Maybe it is the version I use, but for me, I used RAW2DNG to extract my RAW file, I then got Interlaced DNG's then I just selected all the DNG's and dragged them onto the CR2HDR and then I was left with normal looking DNG's that I was able to adjust more dynamically, so this way worked for me.

As for the CR2 stills, I just simply dragged them onto the cr2hdr file, I am using windows version by the way.

Here are the versions I am using.

http://www.mediafire.com/download/j93ojwx50ddv201/Raw2DNG_cr2hdr_550D_Windows.zip

Oh! One important thing, make sure your CR2 or DNG files that you plan to convert are in same folder as the CR2HDR.EXE file or maybe just use simple folder names, I dont think the long folder names work very well when it comes to drag and drop process. Have not tested yet, but I just put my DNG and CR2 files in the folder with CR2HDR.EXE file till it processed them.

Update! Scratch what I said about having to drag the DNG on the CR2HDR.EXE I must of been seeing things earlier cause now that its lighter out I can test more and just dragging the RAW file onto the RAW2DNG.exe I am using I am getting a normal image now and when it is processing I see its working correctly and the DNG files are very dynamic as they were before in my test but I swore the DNG came out interlaced, so Pardon me for my mess up, I must of been viewing a CR2 at the time LOL.

First all: Thank you very much for your efforts! Your hard work is really appreciated!

Strangely i experience the same interlaced look of the DUAL-ISO-RAW-video when converted with the raw2dng-app.
When previewing in LR 5 at 50% everything seems fine, but at 100% or higher its clearly interlaced. Dropping the dngs on the CR2HDR.exe the files look right again.

I also got on CR2-file which won't develop in CR2HDR, it crashes at half way.

Nevertheless i'm very happy about the improvement the ML-dev team brought again to my 550D  :D

@dirty_dollar: i guess its too slow, but just give it a try.
Title: Re: 550D raw video recording port official thread
Post by: FailedRenegade on August 25, 2013, 06:50:47 PM
MK11174 I can't thank you enough for your work getting dual iso working. The first few tests of it I did look great. Now to play with it in video mode...
Title: Re: 550D raw video recording port official thread
Post by: ddelreal on August 26, 2013, 01:13:44 AM
Any chance we might get film-gamma ProRes out of our beloved 550D?
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 26, 2013, 01:54:18 AM
Did some tests with Dual ISO. due to the lower resolution it is ugly as Sin and not really worth it.

http://imgur.com/a/fFzox are some sample stills. These were NOT graded to look pretty, but rather designed to draw out as much detail as possible
Title: Re: 550D raw video recording port official thread
Post by: mairook on August 26, 2013, 02:16:58 AM

Hi, this is my first test. I hope you like it.

http://youtu.be/iW7cWm4Ny2U


Can any one notice some excesive sharpness in the tree areas... how I can fix it?

saludos from México.



<iframe width="960" height="720" src="//www.youtube.com/embed/iW7cWm4Ny2U" frameborder="0" allowfullscreen></iframe>
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 26, 2013, 02:59:52 AM
Did some tests with Dual ISO. due to the lower resolution it is ugly as Sin and not really worth it.

http://imgur.com/a/fFzox are some sample stills. These were NOT graded to look pretty, but rather designed to draw out as much detail as possible
I think Dual ISO was more for those hard lighting situations, not really for quality because it does lose resolution, but certain situations would make it a must have feature. It is for sure not an every situation tool. But when it is the right condition, this feature kicks but!  :D
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 26, 2013, 03:07:30 AM
but certain situations would make it a must have feature.

Hit the nail on the head, my friend :)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on August 26, 2013, 11:54:23 AM
The head post in this thread is updated with the incredible porting work by mk11174 :

*******************************
DUAL ISO for PHOTOS AND VIDEOS !
*******************************

mk11174 for president !!! Now !!!   8)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 26, 2013, 03:20:51 PM
The head post in this thread is updated with the incredible porting work by mk11174 :

*******************************
DUAL ISO for PHOTOS AND VIDEOS !
*******************************

mk11174 for president !!! Now !!!   8)
Thanks 8] And lots of credit to 1% making it much easier to find the addresses for the module with his changes to the adtg module, I couldn't get the module to run stable in live view, but it was just long enough to get the address I needed for Dual Iso module. And of course none of us would have anything without good old Alex! And we can't forget gg3g0 for the original adtg module. And Indi who got us the addresses to even start using the adtg module to find the Dual Iso addresses  ;) I hope I covered everyone lol!
Title: Re: 550D raw video recording port official thread
Post by: zuzukasuma on August 26, 2013, 03:31:49 PM
DUAL ISO & CR2HDR works like a charm
(http://img20.imageshack.us/img20/3306/r3eu.jpg) (http://imageshack.us/photo/my-images/20/r3eu.jpg/)

I really like the results, be back with samples. you can not notice any interlacing even on %100 view. great work folks!
Title: Re: 550D raw video recording port official thread
Post by: Froggy on August 26, 2013, 08:40:42 PM
Amazing!! But how to process the raw video using this????
http://www.mediafire.com/download/j93ojwx50ddv201/Raw2DNG_cr2hdr_550D_Windows.zip (http://www.mediafire.com/download/j93ojwx50ddv201/Raw2DNG_cr2hdr_550D_Windows.zip)
I launched "raw2dng my.raw"and get DNG-files. Processed DNGs in Lightroom....
Sorry, But I didn't see a difference between RAW and RAW-DualISO.
Maybe I do something wrong...
Title: Re: 550D raw video recording port official thread
Post by: jagnje on August 26, 2013, 11:14:50 PM
I`ve been folowing this thread for for a while now...has our beloved 550d finally hit a wall? What is the current best thing you can do with it?
I film alot of skateboarding so 14fps raw is unfortunatly not an option for me. Dual ISO...this I`ve seen for the first time today. Does it help with anything but exposure? I guess it can be very usefull for me when a rider is riding inbetween shade an sun. Anything else?
Time to get the 50D?
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 26, 2013, 11:45:11 PM
i have a sd card speed 6 can i shoot a raw on it ?

Dirty, the short answer is no, well, maybe. yes. My class 6 Scandisk Extreme III cards from 2010 works fine. My newer class 10 cards from Kingston and Micro center write slower and not as long as the the the Scandisk. Get the fastest cards you can afford. Do a little research.

Derrick

Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 26, 2013, 11:52:35 PM
I`ve been folowing this thread for for a while now...has our beloved 550d finally hit a wall? What is the current best thing you can do with it?
I film alot of skateboarding so 14fps raw is unfortunatly not an option for me. Dual ISO...this I`ve seen for the first time today. Does it help with anything but exposure? I guess it can be very usefull for me when a rider is riding inbetween shade an sun. Anything else?
Time to get the 50D?

If you film 960x540 you can blow it up to 720 with no issue, and you can still blow it up to 1080 and it looks fine. You need a fast enough card to actually reach that resolution (over 30MB/s write, otherwise you are trying to push the card to the max and it gets unstable)
Title: Re: 550D raw video recording port official thread
Post by: dirty_dollar on August 27, 2013, 09:58:05 AM
Dirty, the short answer is no, well, maybe. yes. My class 6 Scandisk Extreme III cards from 2010 works fine. My newer class 10 cards from Kingston and Micro center write slower and not as long as the the the Scandisk. Get the fastest cards you can afford. Do a little research.

Derrick

OK thanks Just need a little time for research Sooner
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 27, 2013, 12:35:44 PM
OK thanks Just need a little time for research Sooner

 You would think class all 10 cards read and write fast. Some of them write at a max of only around 15mb/s which is not fast enough for a camera that can write raw video around 21mb/s.

 To me it blows my mind thinking about how Magic Lantern has the T2i a "consumer" camera shooting raw video as opposed to the 5DIII and 50D, professional cameras that are writing raw video files faster than 80mb/s.

 Thanks again ML!

 Derrick
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 27, 2013, 01:50:32 PM
OK thanks Just need a little time for research Sooner

FYI use a site like Bhphotovideo which will have the write speed. Be careful

My old 133x Lexar memorycard says a write speed of 30MB/s but their new 400x cards only have a write speed of 10MB/s
Title: Re: 550D raw video recording port official thread
Post by: pavelpp on August 27, 2013, 09:06:43 PM
Any idea when Dual ISO will make it into nightly ?
Title: Re: 550D raw video recording port official thread
Post by: keba on August 27, 2013, 10:06:47 PM
I'm follow the article here: http://www.thinkdigit.com/Digital-Cameras/Guide-to-using-Dual-ISO-Mode-on_17150.html

but the author did not provide the link to download file needed, the cr2hdr is OK i'm using the one provided by mk11174 http://www.mediafire.com/download/j93ojwx50ddv201/Raw2DNG_cr2hdr_550D_Windows.zip

but how about the stuffs for Dual ISO Video post-processing? (he said sth about avisyn and main.cmd...)

Many Thanks.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on August 27, 2013, 10:15:13 PM
I'm follow the article here: http://www.thinkdigit.com/Digital-Cameras/Guide-to-using-Dual-ISO-Mode-on_17150.html

Why don't you follow the method author's thread?
http://www.magiclantern.fm/forum/index.php?topic=7139.0
Title: Re: 550D raw video recording port official thread
Post by: Yomommassis on August 28, 2013, 05:34:06 AM
Here is a video I shot out around my house testing out the raw video on the T2i, The dynamic range is awesome but the crop factor is a real pain to deal with...Hope more progress is made on the buffer situation to allow for larger resolutions, but still this mod is amazing a and really produces amazing visuals

Once I figure out how to get the dual ISO working on my T2i I'll make a video of that as well  :)
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 28, 2013, 06:17:50 AM
Nice video Yomo! Can you post the specs, workflow and if you resized the image? I thought dual iso only works in photo mode with the T2i.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on August 28, 2013, 06:29:43 AM
mk11174 - a1ex just posted a new file (I believe) "I've uploaded it to cr2hdr_exp.exe," on post 760 over on the Dual ISO post. I know this is the raw post, but since it has been brought up, I'm mentioning it again.

I know I have the ability to compile it myself, but I haven't been able to yet. When you have a moment, can you include the new file? from what I understand, it handles moire/aliasing better (which I guess is more obvious with the dual iso feature)
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 28, 2013, 07:21:30 AM
mk11174 - a1ex just posted a new file (I believe) "I've uploaded it to cr2hdr_exp.exe," on post 760 over on the Dual ISO post. I know this is the raw post, but since it has been brought up, I'm mentioning it again.

I know I have the ability to compile it myself, but I haven't been able to yet. When you have a moment, can you include the new file? from what I understand, it handles moire/aliasing better (which I guess is more obvious with the dual iso feature)
Yeah, I downloaded it and used it and it looks good but I use windows so I did not have to compile anything, are you saying you need a mac version?
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on August 28, 2013, 01:20:08 PM
No. I just wasn't thinking :) I'll just easily replace the file that I have haha sorry, late night last night. Thats good to hear that you had good results from it also!! Very exciting stuff!
Title: Re: 550D raw video recording port official thread
Post by: Kim.dh on August 28, 2013, 11:02:09 PM
Would it be easy to make a Lightroom plugin that copies dual iso cr2's to folder containing cr2hrd and other files, convert them, then re-import the resulting dng into lightroom?
Title: Re: 550D raw video recording port official thread
Post by: Yomommassis on August 29, 2013, 04:47:46 AM
Nice video Yomo! Can you post the specs, workflow and if you resized the image? I thought dual iso only works in photo mode with the T2i.

Of Course!

T2i - 50mm 1.4 - 24mm 1.5 - 70-200 2.8
SanDisk Extreme 45MB/s 32GB

Shot cropped @ 1200x496
Converted with Raw2Dng
Processed curves and color in bridge
Exported as JPEG @ 1920x794
Imported into premiere as sequence
Video limiter, Luma Correcter
Exported as H.264 @1920x794 5MB bitrate

I havent read too much on the dual iso yet for t2i, i hope its all ready for use :/
Title: Re: 550D raw video recording port official thread
Post by: ItsMeLenny on August 29, 2013, 03:22:08 PM
If very wide angle lenses were cheaper/easier to get ones hands on; the crop factor wouldn't be so much of a problem.
Of course it changes how much depth of field one gets and what not, but television cameras usually have quite a small sensor size.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on August 29, 2013, 04:39:05 PM
Haha should I get a micro 4/3 lens adaptor for my 550d? They have wider FOV lenses
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 29, 2013, 07:05:18 PM
Of Course!

T2i - 50mm 1.4 - 24mm 1.5 - 70-200 2.8
SanDisk Extreme 45MB/s 32GB

Shot cropped @ 1200x496
Converted with Raw2Dng
Processed curves and color in bridge
Exported as JPEG @ 1920x794
Imported into premiere as sequence
Video limiter, Luma Correcter
Exported as H.264 @1920x794 5MB bitrate

I havent read too much on the dual iso yet for t2i, i hope its all ready for use :/

I watched it again. Loving those desert shots! Have you tried shooting 960x540, 16x9, 23.97? I'm thinking you have and you just like the look of 1200x496? I'm inquiring because I have a music video shoot tomorrow. The plan is to use the Panasonic LA 7200 anamorphic adapter with a Cosina 28mm lens. You got me thinking about shooting it 1200x496 instead of 960x540. I will go do some test shots...
Title: Re: 550D raw video recording port official thread
Post by: Yomommassis on August 30, 2013, 03:26:46 AM
I watched it again. Loving those desert shots! Have you tried shooting 960x540, 16x9, 23.97? I'm thinking you have and you just like the look of 1200x496? I'm inquiring because I have a music video shoot tomorrow. The plan is to use the Panasonic LA 7200 anamorphic adapter with a Cosina 28mm lens. You got me thinking about shooting it 1200x496 instead of 960x540. I will go do some test shots...

I am a HUGE fan of anamorphic aspect ratio, partly because how we are all so use to 16:9 and 16:10 because of web outlets

Testing out settings because you mentioned it
Since I've shot this video I updated my magic lantern to the latest build with dual ISO

23.976 Global Draw with histogram, waveform, crop overlay
I use to be able to only do 2.42:1 1200x496 continuously for ~510 frames

but with the latest build I am getting

23.976 Global Draw with histogram, waveform, crop overlay, card warmup 1GB
2.42:1 - 1200x496 - 489 Frames
2.39:1 - 1200x502 - 445 Frames
2.35:1 - 1200x510 - 410 Frames
2.20:1 - 1200x546 - 291 Frames

16:9 - 960x540 - Continuous

hope this helps
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 30, 2013, 05:59:37 AM
I am a HUGE fan of anamorphic aspect ratio, partly because how we are all so use to 16:9 and 16:10 because of web outlets

Testing out settings because you mentioned it
Since I've shot this video I updated my magic lantern to the latest build with dual ISO

23.976 Global Draw with histogram, waveform, crop overlay
I use to be able to only do 2.42:1 1200x496 continuously for ~510 frames

but with the latest build I am getting

23.976 Global Draw with histogram, waveform, crop overlay, card warmup 1GB
2.42:1 - 1200x496 - 489 Frames
2.39:1 - 1200x502 - 445 Frames
2.35:1 - 1200x510 - 410 Frames
2.20:1 - 1200x546 - 291 Frames

16:9 - 960x540 - Continuous

hope this helps

It do help me formulate a few more questions. Where did you find that latest build? It looks like you got more frames with the old build? Have you tested the dual iso? I thought we were "supposed" to shoot with Global Draw off What is card warmup 1gb?

Thanks again!
Title: Re: 550D raw video recording port official thread
Post by: Yomommassis on August 30, 2013, 07:52:16 AM
It do help me formulate a few more questions. Where did you find that latest build? It looks like you got more frames with the old build? Have you tested the dual iso? I thought we were "supposed" to shoot with Global Draw off What is card warmup 1gb?

Thanks again!

I'm using this build currently
http://www.mediafire.com/download/kjj8ddkkfmge8vz/ML_550D_Dual_ISO_Aug_25_2013_Update.zip
it was on the first page at the bottom of the first post

Yeah I don't get as many frames with the latest build compared to the build I was using before
I messed with dual ISO very little, so far what im getting is that because it is using every other line the resolution is cut in half..not to big of a problem on the mark 3 @ 1920x1200 but a big problem on the t2i @ 1200x496

Yeah I heard turning off global draw can really help increase recorded frames when shooting in raw but im only find the difference to be 20-30 frames at the most..id rather be able to monitor my levels and histogram while shooting than have 30 more frames...

I guess in the latest build they added some kind of card warm up feature with the raw video, not sure how much it helps if any but on start up your camera writes a file to the sd card and its supposed to increase read/write speeds for shooting raw
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on August 30, 2013, 08:54:01 AM
Yeah I don't get as many frames with the latest build compared to the build I was using before
I messed with dual ISO very little, so far what im getting is that because it is using every other line the resolution is cut in half..not to big of a problem on the mark 3 @ 1920x1200 but a big problem on the t2i @ 1200x496

Maybe try the latest Nightly if it still allows Modules, I have not checked myself since I compile my own. But if it does, try the latest Nightly and just add the Dual Iso module to it to see if it will still work.

The build in that Dual ISO zip is not up to date just the Dual ISO is, but I don't think much has been done to RAW since the build I sent along with the Dual ISO module, but you can try.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on August 30, 2013, 06:19:16 PM
Gentlemen,

Can I ask what the settings you guys are using for the Dual ISO for RAW are. I did a couple tests yesterday.
Dragged them to the raw2dng and then cr2hdr application afterwards, and it mentioned in the DOS window that the images were not interlaced. And then when reviewing the footage, nothing appeared to be anything out of the ordinary from shooting "normal" raw video.

I tried at ISO 400 and the dual ISO set at 3200. Am I missing a setting? I review the post by a1ex and I believe I am doing everything correctly.

Thoughts? Suggestions? Insults? :)
Title: Re: 550D raw video recording port official thread
Post by: kpn on August 30, 2013, 06:51:09 PM
I did some comparison shots

H264 0.1x  1920x1080 16:9
http://i.imgur.com/r0hyb3xh.jpg
H264 1.3x  1920x1080 16:9
http://i.imgur.com/MXH8PBzh.jpg
H264 3.0x  1920x1080 16:9 cropped to 2.35:1
http://i.imgur.com/jGHDmvR.jpg

RAW 2.35:1 / 1152x490
http://i.imgur.com/sXCT4rk.jpg
RAW 2.35:1 / 1152x490 stretched to 2539x1080
http://i.imgur.com/ICh2yMU.jpg

There's no doubt which one looks the best :) RAW is so much sharper and natural looking, also having the ability to edit it in Camera RAW is just unbelievable and it upscales nicely.
Title: Re: 550D raw video recording port official thread
Post by: Yomommassis on August 31, 2013, 12:30:20 AM
Maybe try the latest Nightly if it still allows Modules, I have not checked myself since I compile my own. But if it does, try the latest Nightly and just add the Dual Iso module to it to see if it will still work.

The build in that Dual ISO zip is not up to date just the Dual ISO is, but I don't think much has been done to RAW since the build I sent along with the Dual ISO module, but you can try.

I downloaded the version I had (June 26th) The Version released with Dual ISO (Aug 8th) and the latest nightly as of today (Aug 21st) did a full exFat format and shot the same scene with the same settings and had all build get the around the exact same frames

The only difference I saw the Aug 8th build and the Aug 21st build was they removed the 1200 resolution...I remember reading it was removed because there were certain intervals of resolution that had better write speeds? still though I was quite happy rockin that 1200..guess I'll shoot a different resolution now...
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on August 31, 2013, 02:40:39 AM
I'm using this build currently
http://www.mediafire.com/download/kjj8ddkkfmge8vz/ML_550D_Dual_ISO_Aug_25_2013_Update.zip
it was on the first page at the bottom of the first post

Yeah I don't get as many frames with the latest build compared to the build I was using before
I messed with dual ISO very little, so far what im getting is that because it is using every other line the resolution is cut in half..not to big of a problem on the mark 3 @ 1920x1200 but a big problem on the t2i @ 1200x496

Yeah I heard turning off global draw can really help increase recorded frames when shooting in raw but im only find the difference to be 20-30 frames at the most..id rather be able to monitor my levels and histogram while shooting than have 30 more frames...

I guess in the latest build they added some kind of card warm up feature with the raw video, not sure how much it helps if any but on start up your camera writes a file to the sd card and its supposed to increase read/write speeds for shooting raw

I can wait until I learn more about dual iso however I will start using global draw and card warmup now. Thanks! 
Title: Re: 550D raw video recording port official thread
Post by: keba on August 31, 2013, 05:08:52 PM
Any one successfully shots dual iso video and then post processing OK? mine case after download mk11174 cr2hdr and raw2dng file, dual iso raw video file still interlaced after using raw2dng (drag and drop method)

any methods that work for our beloved 550D? (i'm try to use alex method: using his raw2dng first and then cr2hdr but bad result in the end)
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on August 31, 2013, 05:26:47 PM
Any one successfully shots dual iso video and then post processing OK? mine case after download mk11174 cr2hdr and raw2dng file, dual iso raw video file still interlaced after using raw2dng (drag and drop method)

any methods that work for our beloved 550D? (i'm try to use alex method: using his raw2dng first and then cr2hdr but bad result in the end)

Son of a Batch has dual ISO support :)
Title: Re: 550D raw video recording port official thread
Post by: Khayam on August 31, 2013, 06:44:20 PM
Hi everyone, this is long past due as I've been using ML for a while.

I was planning on shooting a short film in two weeks on the 5D RAW but that project got postponed to an unspecified date. So i thought I'd play around with the RAW thing on my trusty T2i. I have a small short-film coming in less than a month (much less ambitious than the other one) and figured it would make a nice opportunity. It would be the sequel of something I shot one year ago when I was kindda knew to the DSLR filmmaking (lots of things went wrong, starting with sunset being faster than expected) :

http://youtu.be/kTjBGDKaz-s
(I'm not embedding it because some might think this is a RAW capability showcasing).


Anyway, I was wondering if the actual capabilities are enough to consider to shooting RAW. The first post is not very informative, stating the problems rather than what's actually possible today. At what resolution can I hope for continuous recording ? I have a single SanDisk Extreme 30MB/s 16 GB and I'm getting the feeling it's not enough.

Also, during shooting, what can I hope for in terms of control. Is LiveView working properly during recording ? Is there some kind of playback (I'm guessing not but maybe it's possible to look at the single pictures ?) ?

Thanks a lot for the amazing job going on here.
Title: Re: 550D raw video recording port official thread
Post by: lemuet on September 01, 2013, 03:37:52 AM
960x540@24fps is maximum for continuous shooting at the moment, it is not possible to go higher regardless of card speed. Well, you can set lower fps to go a bit higher resolution if what you are planning to shoot does not have much movement or if it's a look you are going for and if you can work with short clips.

Personally after doing my own tests (nothing scientific, just random test shots), I really like the "look" it has but I would say generally there are more disadvantages at this point for shooting a "real" project using RAW on 550d. It's a lot of fun and quite amazing what is possible to do in terms of color grading but there are a lot of things to consider:

I don't know the exact factor, but there is MAJOR crop, it looks like 2x to me, so you have to consider which lenses you plan on using because your wide angle lens definitely won't be wide angle anymore ;). Basically (as I understand it), the 960x540 is cropped area in center of censor, rather than having full censor image resized to fit the resolution (ie: unlike shooting 1080p vs 720p h264). So when using Live view you will see cropmarks in center of image showing you where image will be cropped (very small).

The 960x540 resolution actually looks surprisingly good when blown up to 1080p, but of course it can't be as sharp as real 1080p and there can be a lot of aliasing, so you have to keep that in mind depending on your shooting locations and what is seen in your shots (ie: telephone lines will look very aliased).

It is possible to see clip playback in camera but I think it's very beta at the moment, video plays in b/w and is slowmo.

Then there is the RAW workflow, there is a lot of posts in this thread and many others about it, you will have to do some research there. So far I only tested using trial version of GingerHDR which allows me to import and edit raw clips in Premiere/AE directly without converting. It's a bit pricy for me because I have no interest in HDR itself which is the main point of that plugin, so I don't think I'm going to buy it once trial runs out.

As for card speed I have the SandDisk Extreme 32gb@45mb/s and it works without any problems. I'm not sure the 30mb/s version will be fast enough for continuous shooting, you will have to test and see for yourself. Also keep in mind that 16gb is going to fill up very quickly ;)

Hmm, okay that is all I can think of for now. Personally I find it very interesting to experiment with but there are too many things that could go wrong during a shoot to be worth it IMO, especially on a shoot with actors where there is a need for multiple takes and such. The low resolution, regardless of sharpening you can do and color grading, still won't be as sharp at real 1080p and will be obvious, ie: I would not shoot a commercial that way! I would (and will) use it for more "artsy" projects that I do for myself. To me it looks like something between 8mm and 16mm film, interestingly enough when raising exposure in post adds to this illusion because the iso noise is quite big, almost 8mm grain style. Black and white + blown up to 1080p + additional film grain looks very lovely to me :)

In the end it mostly makes me frustrated that I don't have money for the 5D Mark III, hehe. But still, I'm going to have a lot of fun with it!

Good luck!
Title: Re: 550D raw video recording port official thread
Post by: keba on September 01, 2013, 03:57:28 AM
Son of a Batch has dual ISO support :)
It'll be very kind of you for providing the hyperlink, Many Thanks.
Title: Re: 550D raw video recording port official thread
Post by: David J. Fulde on September 01, 2013, 06:09:24 AM
It'll be very kind of you for providing the hyperlink, Many Thanks.

Sorry! ha ha http://www.magiclantern.fm/forum/index.php?topic=7266.0
Title: Re: 550D raw video recording port official thread
Post by: keba on September 01, 2013, 06:35:28 AM
Sorry! ha ha http://www.magiclantern.fm/forum/index.php?topic=7266.0
Thanks David!
What a pity that i'm using Windows, but thanks anyway!
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 01, 2013, 10:47:35 AM
Any one successfully shots dual iso video and then post processing OK? mine case after download mk11174 cr2hdr and raw2dng file, dual iso raw video file still interlaced after using raw2dng (drag and drop method)

any methods that work for our beloved 550D? (i'm try to use alex method: using his raw2dng first and then cr2hdr but bad result in the end)

I'm having a different issue. What settings are you using. My issue isnt a matter of they not becoming....er....un-interlaced. I just keep getting a messaged that the footage doesnt appear to be interlaced, and after reviewing it....it isn't. I'm shooting raw video and choosing the dual ISO option. I must be overlooking something.

EDIT: despite what it says, it's working now! I reviewed the image before and after and it definitely went from interlaced to a "useable" video/image sequence! awesome stuff!
Title: Re: 550D raw video recording port official thread
Post by: NedB on September 01, 2013, 11:49:37 AM
@telecastDaveRI: Would you mind telling us exactly what ML you're using and also what cr2hdr.exe and raw2dng.exe (links if you have them)? I had an experience similar to yours where I thought it didn't work and then all of a sudden I thought, "Oh, yes it did". So I put dual-iso aside for a few days, hoping it would become clear what the issue was. If you'd tell us exactly how you got your results, I'll try to reproduce and then report back. Thanks in advance and cheers!

Edit: Oh, and if you don't mind, what dual-iso settings/resolution/etc. Just to eliminate other causes of "failure"...
Title: Re: 550D raw video recording port official thread
Post by: keba on September 01, 2013, 01:53:32 PM
I'm having a different issue. What settings are you using. My issue isnt a matter of they not becoming....er....un-interlaced. I just keep getting a messaged that the footage doesnt appear to be interlaced, and after reviewing it....it isn't. I'm shooting raw video and choosing the dual ISO option. I must be overlooking something.

EDIT: despite what it says, it's working now! I reviewed the image before and after and it definitely went from interlaced to a "useable" video/image sequence! awesome stuff!
Dear telecastDaveRI,
I do have same request as NedB. Hope that you can share a bit about your success. Thanks!

BTW, while recording using live view i can zoom 5x but 10x make my camera crash immediately, so how can we do the proper focus without zoom in and how to back to normal view after 5x zoom (as above 10x crash)
Title: Re: 550D raw video recording port official thread
Post by: Khayam on September 01, 2013, 02:06:00 PM
960x540@24fps is maximum for continuous shooting at the moment, it is not possible to go higher regardless of card speed. Well, you can set lower fps to go a bit higher resolution if what you are planning to shoot does not have much movement or if it's a look you are going for and if you can work with short clips.

[...]

Good luck!

Thanks mate, that's a lot of useful info. The crop factor thing seems to be the most annoying for me. I like wide angle shots and I bought a Tokina 116 for that. The google doc (https://docs.google.com/spreadsheet/ccc?key=0AgQ2MOkAZTFHdFFIcFp1d0R5TzVPTVJXOEVyUndteGc#gid=5) doesn't make mention of the cropping factor in continuous recording. I'll try and check that by myself.

This is just a small project with friends, no real actors or crew so it's not that much of a problem if things go wrong. I like what you're saying about the footage looking like 8mm film and I'm definitely checking this thing up asap.
Title: Re: 550D raw video recording port official thread
Post by: Rewind on September 01, 2013, 03:29:22 PM
Quote
BTW, while recording using live view i can zoom 5x but 10x make my camera crash immediately, so how can we do the proper focus without zoom in and how to back to normal view after 5x zoom (as above 10x crash)

Just go to Prefs — LiveView zoom tweaks, and switch the x10 off.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 01, 2013, 09:04:16 PM
hello guys, I'll be out for the day, but now I am getting interlaced footage no problem. I just did a quick test before I am walking out the door.
I choose alternate lines (it's a setting under dual iso...I dont have my camera in front of me)
but now I am having issues with it converting!! I dropped the raw into raw2dng, and then from there I moved it over to the the cr2hdr_exp.exe and nothing happened! (a DOS window flashed, and disappeared)

When I get home and play with it some more I will provide the links and any success I have.

EDIT: to keep things organized, I had it in a folder within a folder. I then moved the dngs to the root folder and they converted!! The thing is....now, they are no longer interlaced. What I personally would like to test is if the ISO is actually having an impact or if I am just interlacing and deinterlacing "normal" raw footage :)
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 01, 2013, 09:26:09 PM
Rewind,

What module did you add so that it would crop everything but the area that was being recorded? (everything else was black)
That was useful :)

Was that you that compiled the release that included that?
Title: Re: 550D raw video recording port official thread
Post by: Rewind on September 01, 2013, 09:33:49 PM
Quote
Was that you that compiled the release that included that?

Yes, I've just added a couple of figures to Pravdomil's source to get more usable resolutions like 1200:
https://bitbucket.org/pravdomil/magic-lantern-hack/commits/all
and compiled it.

Here is the raw_rec (http://moredo.ru/raw/RAW_REC.7z)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on September 02, 2013, 03:12:57 PM
Hi folks !

It will be useful if you can share all of your testings about raw video recordings data and card speeds here: http://www.magiclantern.fm/forum/index.php?topic=8000.msg72051#msg72051

So this thread will not bloat !  ;D

Select the first links about the testings ! Many thanks !  ;)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on September 02, 2013, 03:44:19 PM
I did some comparison shots

H264 0.1x  1920x1080 16:9
http://i.imgur.com/r0hyb3xh.jpg
H264 1.3x  1920x1080 16:9
http://i.imgur.com/MXH8PBzh.jpg
H264 3.0x  1920x1080 16:9 cropped to 2.35:1
http://i.imgur.com/jGHDmvR.jpg

RAW 2.35:1 / 1152x490
http://i.imgur.com/sXCT4rk.jpg
RAW 2.35:1 / 1152x490 stretched to 2539x1080
http://i.imgur.com/ICh2yMU.jpg

There's no doubt which one looks the best :) RAW is so much sharper and natural looking, also having the ability to edit it in Camera RAW is just unbelievable and it upscales nicely.

VERY interesting ! Many thanks ! Can you tell what software and parameters inside it you used to stretch the last image ? Many thanks !
Also: what means 0.1x - 1.3x and 3.0x ? Zoom factors of the lens or the "quality factor booster" of h264 magic lantern ? Or what else ?
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 02, 2013, 07:14:23 PM
@telecastDaveRI: Would you mind telling us exactly what ML you're using and also what cr2hdr.exe and raw2dng.exe (links if you have them)? I had an experience similar to yours where I thought it didn't work and then all of a sudden I thought, "Oh, yes it did". So I put dual-iso aside for a few days, hoping it would become clear what the issue was. If you'd tell us exactly how you got your results, I'll try to reproduce and then report back. Thanks in advance and cheers!

Edit: Oh, and if you don't mind, what dual-iso settings/resolution/etc. Just to eliminate other causes of "failure"...

I tried both the cr2hdr.exe and cr2hdr_exp.exe (the former is in the first post on the "dual ISO- massive..." forum.) and the raw2dng listed under this forum, and now I am getting interlaced footage, but no matter what, the cd2hdr doesnt recognize it as interlaced and nothing changes. I had my settings at 100/1600 and 1200 frame size at a 3:1 aspect ratio, just to test. The other night, I took some footage and I was successful, but I cant recreate it. Anyone else having success with dual iso and raw? I'm going to keep testing today.

EDIT: popping the footage in After Effects and de-interlacing there works just fine. Still curious if I am missing something.
Title: Re: 550D raw video recording port official thread
Post by: NedB on September 02, 2013, 09:56:10 PM
@telecastDaveRI: For our "low-information" readers and noobs, we should probably avoid calling Dual-ISO footage "interlaced", although I certainly know what you mean. If you are shooting Dual-ISO correctly (I mean, maybe not optimally, but getting footage where alternating lines have different ISO values), the individual frames look "interlaced", except that the two sets of lines are of course not separated in time by a half a frame, like NTSC or PAL interlaced footage. On the other hand, you can't "de-interlace" this footage in After Effects, because it isn't "interlaced", it's just Dual-ISO, which is a completely different concept. What you are seeing as successfully "de-interlaced" footage in AE is just a result which eliminates or blends alternating lines to make the individual frames look "smooth". But what a1ex does in his dual-iso software (originally an updated version of raw2dng.exe, but recently he is suggesting using cr2hdr.exe) is a fairly complicated mix of interpolation, estimation, prediction,etc., which attempts to combine the best pixels from the alternating-line footage in order to give you an image with an increased dynamic range. I can't stress it enough: though the dual-iso footage looks "interlaced", it is NOT interlaced in the true sense of the word. For what it's worth, I still can't figure out how to do the second step of a1ex's suggested dual-iso video workflow, that is, to "drag-and-drop" the .dng files on top of the cr2hdr.exe executable. When I do that, nothing seems to happen. When I open a command line, navigate to the location of cr2hdr.exe, and run it with a command like "cr2hdr.exe thingy.dng", where "thingy.dng" is one frame from some dual-iso footage, then sometimes this seems to work and produce a frame which no longer looks, um..."interlaced". But sometimes not, and this is obviously not a workable solution if your dual-iso footage contains hundreds or thousands of frames.

I guess we're both waiting for someone to chime in who has this working reliably (on a PC, I might add). It's fun to play with but I wouldn't want to use dual-iso unless I had a situation where I had to, as the resulting aliasing issues make it hard for me to accept the resulting images, noise-free (or close to it) though they may be. Cheers!
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 02, 2013, 10:23:55 PM
@telecastDaveRI: For our "low-information" readers and noobs, we should probably avoid calling Dual-ISO footage "interlaced", although I certainly know what you mean. If you are shooting Dual-ISO correctly (I mean, maybe not optimally, but getting footage where alternating lines have different ISO values), the individual frames look "interlaced", except that the two sets of lines are of course not separated in time by a half a frame, like NTSC or PAL interlaced footage. On the other hand, you can't "de-interlace" this footage in After Effects, because it isn't "interlaced", it's just Dual-ISO, which is a completely different concept. What you are seeing as successfully "de-interlaced" footage in AE is just a result which eliminates or blends alternating lines to make the individual frames look "smooth". But what a1ex does in his dual-iso software (originally an updated version of raw2dng.exe, but recently he is suggesting using cr2hdr.exe) is a fairly complicated mix of interpolation, estimation, prediction,etc., which attempts to combine the best pixels from the alternating-line footage in order to give you an image with an increased dynamic range. I can't stress it enough: though the dual-iso footage looks "interlaced", it is NOT interlaced in the true sense of the word. For what it's worth, I still can't figure out how to do the second step of a1ex's suggested dual-iso video workflow, that is, to "drag-and-drop" the .dng files on top of the cr2hdr.exe executable. When I do that, nothing seems to happen. When I open a command line, navigate to the location of cr2hdr.exe, and run it with a command like "cr2hdr.exe thingy.dng", where "thingy.dng" is one frame from some dual-iso footage, then sometimes this seems to work and produce a frame which no longer looks, um..."interlaced". But sometimes not, and this is obviously not a workable solution if your dual-iso footage contains hundreds or thousands of frames.

I guess we're both waiting for someone to chime in who has this working reliably (on a PC, I might add). It's fun to play with but I wouldn't want to use dual-iso unless I had a situation where I had to, as the resulting aliasing issues make it hard for me to accept the resulting images, noise-free (or close to it) though they may be. Cheers!

NedB, you are absolutely right with everything that you are saying. Yes, all After Effects is doing is blurring the "lines" a  little and that's not really accomplishing anything. As far as the problem that you have with the nothing happening, do you have the program and all the dngs in the same folder? I have been able to do it every time, but for me, nothing appears to happen after I run the program and review the footage. If you havent been keeping the program and files in the same folder, and try that soon -  and it works, I'd like to see how well you make out on any future tests.
Title: Re: 550D raw video recording port official thread
Post by: kpn on September 03, 2013, 10:33:45 AM
VERY interesting ! Many thanks ! Can you tell what software and parameters inside it you used to stretch the last image ? Many thanks !
Also: what means 0.1x - 1.3x and 3.0x ? Zoom factors of the lens or the "quality factor booster" of h264 magic lantern ? Or what else ?

Thanks! I used Instant HD to stretch the last image. But it doesn't make a huge difference, just stretching a composition in AE does the trick.
You're right, 0.1x etc. is the bitrate of h264 in ML. I noticed that if I don't go over ISO 800 I can film on 3.0x without stopping. And it does make a difference.
I'll make some more tests and add it to this post in a while.
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on September 03, 2013, 12:49:44 PM
Thanks! I used Instant HD to stretch the last image. But it doesn't make a huge difference, just stretching a composition in AE does the trick.
You're right, 0.1x etc. is the bitrate of h264 in ML. I noticed that if I don't go over ISO 800 I can film on 3.0x without stopping. And it does make a difference.
I'll make some more tests and add it to this post in a while.

Great ! I'm keeping an interesting ML directory, where we can keep together all our tests. Go here and then select the first item (video tests) and then begin contributing ! I also inserted this tests you made ! I hope you like the idea ! --> http://www.magiclantern.fm/forum/index.php?topic=8000.msg72051#msg72051
Title: Re: 550D raw video recording port official thread
Post by: mine85 on September 03, 2013, 05:43:53 PM
First off big thanks to all dealing with this tremendous piece of software. Y'all are Godsent.
Now, I've followed all the steps in the Dual IOS pipeline (Convert RAW -> DNG via raw2dng), drag the files to cr2hdr.
The resulting image seems underexposed after importing the sequence into After Effects.

One thing I noted during cr2hdr post process was this error in the console;

"black subtract didn't work"

(http://i41.tinypic.com/25ez79i.jpg)

Below are the settings used. Hope the info is sufficient;

Dual ISO: 100/1600
Dynamic Range Gained: 2.1 EV
Midtone overlapping: 8ev
Alternate frames only: OFF

Any suggestions are highly appreciated!  :)

Y.K
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 04, 2013, 04:27:13 AM
mk11174,

What is your workflow for the 550D for the dual ISO?
I saw the posts over at the dual ISO post and saw that the cr2hdr was just updated yesterday.
However, was that just to fix an issue with the 600D? Have you had success with the t2i? Are you just recording the video, converting to DNG, and then dragging into the application (cr2...)?

Any insight would be helpful. We aren't getting consistent results.
Title: Re: 550D raw video recording port official thread
Post by: mk11174 on September 04, 2013, 04:42:08 AM
mk11174,

What is your workflow for the 550D for the dual ISO?
I saw the posts over at the dual ISO post and saw that the cr2hdr was just updated yesterday.
However, was that just to fix an issue with the 600D? Have you had success with the t2i? Are you just recording the video, converting to DNG, and then dragging into the application (cr2...)?

Any insight would be helpful. We aren't getting consistent results.
I just use the RAW2DNG.exe for windows to extract the RAW file then drag and drop the DNG files onto the CR2HDR.exe file for windows and it merges the interlaced ISO DNG's into a normal looking DNG that you can adjust in Adobe Camera Raw but now with more dynamic range.

The only issue I ever had was it not converting the DNG when I dragged it onto the CR2HDR file, but I later found out it was because the CR2HDR file had to be in same folder as DNG files.

I guess if you getting bad results, it might just be to much of a dynamic range that your trying to achieve. Only time I ever had an issue.

The new CR2HDR file seems to work the same for my 600D and 550D. I have not really shot anything worth using Dual_ISO on though, I like the non Dual_ISO versions better for all the stuff I have shot so far just because I usually see alot of dead pixels with DUAL_ISO and also lots of artifacts around tree leaves in the distance and power lines but only if you get picky and look at them  at more then 100%.

It is a cool feature but really has to be the right type of scene to be useful. Maybe it works better for the higher end cams though.
Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 04, 2013, 04:52:06 AM
I guess if you getting bad results, it might just be to much of a dynamic range that your trying to achieve. Only time I ever had an issue.

I wonder if this is MY issue. I've tried this at night within my house and the shadows may have been way too dark vs the light in the scene. Now that you mention it, I thought I read somewhere that someone had a similar issue with TOO much dynamic range.

Hmmm....may have to adjust my testing. Thanks for the reply. 
Title: Re: 550D raw video recording port official thread
Post by: zuzukasuma on September 04, 2013, 01:35:06 PM
Maybe it works better for the higher end cams though.

well, you're right, it is what it is. 550D is a cheap-old camera but 5D Mark III is the new master after 5D mark II. I think its wrong to wait same performance on entry level DSLRs.
Title: Re: 550D raw video recording port official thread
Post by: SleeperNinja on September 05, 2013, 03:04:13 PM
My first try at RAW video with 5x zoom and kit lens zoomed all the way out to 18mm.


Description: 1:1 crop from sensor so there's no aliasing or moire from line skipping. Recorded @ 1024x448 and upscaled with Instant HD to 1280x560.  Minor color correction and sharpening in ACR.  Shot with the crappy kit lens (EF-S 18-55mm).

Any one else getting the pink corrupted frames more in 5x mode?  Is there any way to get the box to display right in 5x mode?

Update: As soon as I posted this here, YouTube removed the 720p option...

Update 2: YouTube removed the 720p option at 1280x560 so I resized this one to 1646x720 in After Effects in High Quality hoping YouTube would keep the 720p option this time.  Embed code linked to new video.

I grade in Camera Raw, then import tiff files into Quicktime Pro--when I export from Quicktime Pro (ProRes4444), I have the option of maintaining the aspect by letterbox--you could preserve the 720p option by doing that.

(http://25.media.tumblr.com/45b24a6e33ec4d7cd1072db6612cb710/tumblr_msnl28ndPP1rkqob0o1_1280.png)

You could even just open the cropped video, and use the same process to add the bars.

(http://25.media.tumblr.com/8811e1474ea216cebefd6de74a0a0407/tumblr_msnl28ndPP1rkqob0o2_1280.png)
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on September 05, 2013, 05:15:15 PM
Dear telecastDaveRI,
I do have same request as NedB. Hope that you can share a bit about your success. Thanks!

BTW, while recording using live view i can zoom 5x but 10x make my camera crash immediately, so how can we do the proper focus without zoom in and how to back to normal view after 5x zoom (as above 10x crash)

Keba hit the menu button to exit the 5x mode.

Derrick
Title: Re: 550D raw video recording port official thread
Post by: xmikefloodx on September 05, 2013, 09:04:47 PM
I just got a little something together finally

http://youtu.be/7UpIWQIiaN0

i really hope someone makes a controller to get a higher write speed into the t2i
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 06, 2013, 01:51:47 AM
did anyone use magic bullet instant HD with raw video yet? probably yes... :)
Title: Re: 550D raw video recording port official thread
Post by: synden on September 07, 2013, 11:27:26 AM
Too lazy to look through all 41 pages. Anyone who can be a nice boy/girl and link download for a full working RAW video ML for 550D? Also a quick little guide. Or is it just to install like the regular ML? Thanks guys :)
Title: Re: 550D raw video recording port official thread
Post by: dlrpgmsvc on September 07, 2013, 12:13:37 PM
Too lazy to look through all 41 pages. Anyone who can be a nice boy/girl and link download for a full working RAW video ML for 550D? Also a quick little guide. Or is it just to install like the regular ML? Thanks guys :)

... Even too lazy to read the first post ?  :'(
Title: Re: 550D raw video recording port official thread
Post by: synden on September 07, 2013, 12:25:16 PM
... Even too lazy to read the first post ?  :'(

I read the first page and downloaded MK11174's latest build with DUAL ISO. Was just wondering if that one works, if it's stable and how long and good clips you get? And if it's just to install it like the regular ML build without RAW? Is there any installation guide?
Would appreciate if people could say which build they use for their videos and so on :)
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 07, 2013, 03:47:17 PM
I was in the same boat as you 3 days ago and I downloaded the same build and it all works just as the previous version.
Haven`t tried the dual iso yet, and can`t really comment on lenghts of the raw, because I just did a couple of test shots. But so far, for what I film(skateboarding) raw will probably not be something to use all the time. The crop, kills it. Othervise it looks good, just as long your not glued to the screen, step a couple steps back and it looks better than h.264 full HD.
But as I said, crop, no playback, not being able to erase clips on camera and the fact that a 16gb card would be filled in a couple of minutes are the drawbacks. I was scouting the net the other day and saw that someone developed a software for 550d to record 2 and 4k video, but it seem that it was a hoax. That would be something I would be interested in very much and 120fps :)
daydreaming :D
Short...I would use raw to show off to friends, as far as youtube and vimeo goes, most will not notice the diference. At least not for the type of filming I do.

Title: Re: 550D raw video recording port official thread
Post by: telecastDaveRI on September 07, 2013, 06:09:05 PM
I read the first page and downloaded MK11174's latest build with DUAL ISO. Was just wondering if that one works, if it's stable and how long and good clips you get? And if it's just to install it like the regular ML build without RAW? Is there any installation guide?
Would appreciate if people could say which build they use for their videos and so on :)

The build mentioned in the video is a little old, but you can download the newest one from the first post as mentioned.

Title: Re: 550D raw video recording port official thread
Post by: synden on September 07, 2013, 08:06:44 PM
I was in the same boat as you 3 days ago and I downloaded the same build and it all works just as the previous version.
Haven`t tried the dual iso yet, and can`t really comment on lenghts of the raw, because I just did a couple of test shots. But so far, for what I film(skateboarding) raw will probably not be something to use all the time. The crop, kills it. Othervise it looks good, just as long your not glued to the screen, step a couple steps back and it looks better than h.264 full HD.
But as I said, crop, no playback, not being able to erase clips on camera and the fact that a 16gb card would be filled in a couple of minutes are the drawbacks. I was scouting the net the other day and saw that someone developed a software for 550d to record 2 and 4k video, but it seem that it was a hoax. That would be something I would be interested in very much and 120fps :)
daydreaming :D
Short...I would use raw to show off to friends, as far as youtube and vimeo goes, most will not notice the diference. At least not for the type of filming I do.

The build mentioned in the video is a little old, but you can download the newest one from the first post as mentioned.


Okey, thanks guys. I will try to install the latest one. Just pop it in and try it and follow a video tutorial for install. Do I need to care about the text on the first page:
"Current state-of-the-art :

Problem : Raw video recording works, finally !...." about all the steps and so on?
Title: Re: 550D raw video recording port official thread
Post by: SleeperNinja on September 08, 2013, 07:43:51 AM
That was a tad hostile.  ;D

If you produce to blu-ray, you have to produce a full 1920x1080 frame, and the suggestion solves the youtube problem, as well. I understand your dismay with letterbox, but I suggest withholding your judgment until you understand why such things exist, rather than making noob comments to someone who is here to help you.
I found out later that YouTube just says 480p but if you view the stats it'll say 1280x536 or w/e but anyway... I HATE EVERYTHING about what you just said.  Letterboxing is the fucking worst shit you can do.  It fucks up everything because you can't assume aspect ratio.  NEVER add black bars. Thanks anyway lol
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on September 08, 2013, 08:32:04 AM
That was a tad hostile.  ;D

If you produce to blu-ray, you have to produce a full 1920x1080 frame, and the suggestion solves the youtube problem, as well. I understand your dismay with letterbox, but I suggest withholding your judgment until you understand why such things exist, rather than making noob comments to someone who is here to help you.

Nothing was hostile because there was nothing directed to you - it was an opinion stated with how I really felt about it.  I never asked for help - I never needed help - in my previous post before that one I already said the problem was fixed without blackbars.

I don't need to withhold "judgement" because I already understand "why such things exist" - and I can still claim they are shitty reasons especially considering the context was nothing to do with blu-ray and everything to do with YouTube.  Do you understand you are wasting bitrate/memory/space/compression when you have blackbars doing nothing?  Do you understand when you have different aspect ratios (since we're talking about internet release not blu-ray) like 4:3, 16:9, 16:10, 5:4, those black bars screw that up?
Title: Re: 550D raw video recording port official thread
Post by: RenatoPhoto on September 08, 2013, 01:40:19 PM
Before this heads in the wrong direction, please remember to cool your engines and keep personal stuff to PM, emails or other personal communication device.  Do not put it on this board to keep the thread useful.
Thanks
Title: Re: 550D raw video recording port official thread
Post by: Adaunn on September 08, 2013, 01:57:22 PM
Might as well register. I was getting ready to sell this camera till I went forth and tried ML. Installed it with really no issues and I'm loving it. Can't shoot much till my new fast SD card shows up. I went with the Sony SDHC, 45mbs card. Should be enough and the price was just right.

Title: Re: 550D raw video recording port official thread
Post by: carniolus on September 08, 2013, 08:28:46 PM
Hello guys!

I am new here. I`ve decided to test out one of my cameras and in this case EOS 550d. I made a short movie and it is my first test of making Raw video. I`ve squeezed out a max from this camera at the moment. Here are some data:

Lense; Sigma 30 mm f/1.4
SD Sandisk Extreme 30MB/s

Settings;
Aspect ratio; 1728x864; 2:1
Shooting in 23,976 Full HD mode

I had no bad frames. The big issue here is that in this settings I can get out only 24 frames and than camera stops shooting. I slowed the footage down to 60 % of original.

I`ve recorded arround 60 videos and with DOS extration method I have a couple of hours of work just to extracting these files. Is there some other - faster method than this? I would be very glad for any kind of information...

Somewhere I`ve noticed  that writing speeds of SD card system in EOS 550d is max to 30 MB/sec. Is this true? In this case I will have to wait for some stable version of ML for my Canon 7D to do RAW with 1000x CF card. Because in this case it is not appropriate to work serious.

Here you can see my work:

I did not put a lot of effort to editing this work, but anway what do you think?  :)
Cheers from Slovenia!
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on September 08, 2013, 09:26:42 PM
Before this heads in the wrong direction, please remember to cool your engines and keep personal stuff to PM, emails or other personal communication device.  Do not put it on this board to keep the thread useful.
Thanks

You guys are ridiculous - I guess I will have to post a video response later to show how lame you guys are.  There are no hostile intentions. There are no personal attacks.  There IS opinions stated.  Some people swear more - that has no bearing on my "engines" - that's how I talk.  It sounds like if something doesn't sound politically pretty, you censor, then warn me.  wow... pretty sad considering the true context.
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 08, 2013, 10:01:51 PM
I was under the impression that raw playback works on a 550d...mine doesn`t. Does it work with any of the builds?
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on September 08, 2013, 10:23:21 PM
I was under the impression that raw playback works on a 550d...mine doesn`t. Does it work with any of the builds?

Oh, you just need the file manager module enabled and you can play everything from there :]
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 08, 2013, 10:40:50 PM
I only got raw, ettr and dual iso modules to enable? am I missing it in some submenu?
edit: ok, figured it out :)
Title: Re: 550D raw video recording port official thread
Post by: buffalohill on September 08, 2013, 10:51:23 PM
Tis might be a stupid question, but taking into account the limitations of the d550, would it be possible to shoot 1080p RAW in black and white? Is there such a method available? Could it be implemented? I'm interested in B/W filming and if possible, then the d550 could be ideal. From my limited technological understanding I'd assume that the data stream would be ~ 1/3 of that of color, so at least 720 RAW should be possible continuously, no? Any thoughts...?
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on September 08, 2013, 10:52:57 PM
I only got raw, ettr and dual iso modules to enable? am I missing it in some submenu?

Oh you know what, on that particular release they didn't add the file manager.  Try using another build that has it, or try copy and pasting the file manager module in the modules folder and see if you can enable it in ML.
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 08, 2013, 10:58:54 PM
I fuguered out that playback is in raw menu. With file manager can you delete files as well?
Title: Re: 550D raw video recording port official thread
Post by: tactzer0 on September 08, 2013, 11:02:33 PM
Yeah you can delete files from there.  File manager also lets you play any other raw file you've recorded.  Not just the last one you recorded.
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 08, 2013, 11:06:25 PM
sweet, thank you!
Title: Re: 550D raw video recording port official thread
Post by: BrotherD on September 09, 2013, 03:43:18 AM
Hello guys!

I am new here. I`ve decided to test out one of my cameras and in this case EOS 550d. A make a short movie and it is my first test of making Raw video. I`ve squeezed out a max from this camera at the moment. Here are some data:

Lense; Sigma 30 mm f/1.4
SD Sandisk Extreme 30MB/s

Settings;
Aspect ratio; 1728x864; 2:1
Shooting in 23,976 Full HD mode

I had no bad frames. The big issue here is that in this settings I can get out only 24 frames and than camera stops shooting. I slowed the footage down to 60 % of original.

I`ve recorded arround 60 videos and with DOS extration method I have a couple of hours of work just to extracting these files. Is there some other - faster method than this? I would be very glad for any kind of information...

Somewhere I`ve noticed  that writing speeds of SD card system in EOS 550d is max to 30 MB/sec. Is this true? In this case I will have to wait for some stable version of ML for my Canon 7D to do RAW with 1000x CF card. Because in this case it is not appropriate to work serious.

Here you can see my work:

I did not put a lot of effort to editing this work, but anway what do you think?  :)
Cheers from Slovenia!

Very nice composition and images! Have you tried any other settings? I shot a music video Friday with some settings recommended on this site: menu, 720, Magic Lantern frame override 23.97, 1200x344. I like having many shooting option with ML.

I use Eyeframe. Open, drop raw files in, give it "20" seconds to ask for file location for the dng's and tiff's. Select folder. Pictures of tiff's show up in box. If you need proxies click convert and select type of proxy from pull down menu. I think Eyeframe is fast but I have not compared it to another program or an expert on the "best" program to use.
Title: Re: 550D raw video recording port official thread
Post by: carniolus on September 09, 2013, 07:56:07 AM
Thanks BrotherD.
Yes I tryed also some other Aspect ratio, but not enough I guess. Thank you very much for the tip with Eyeframe.
Title: Re: 550D raw video recording port official thread
Post by: zuzukasuma on September 09, 2013, 05:26:31 PM
people complaining about small RAW res of 550D can follow this thread -> http://www.magiclantern.fm/forum/index.php?topic=8116.0
Title: Re: 550D raw video recording port official thread
Post by: robinson brothers on September 09, 2013, 05:52:46 PM
Would this help with Up scaling? This news just came out.

http://tv.adobe.com/watch/adobe-at-ibc-2013/after-effects-cc-detailpreserving-upscale/
Title: Re: 550D raw video recording port official thread
Post by: zuzukasuma on September 09, 2013, 06:39:05 PM
Would this help with Up scaling? This news just came out.

http://tv.adobe.com/watch/adobe-at-ibc-2013/after-effects-cc-detailpreserving-upscale/

actually the software (nuke) way more expensive than complete CC suite. but it can help for resizing RAW footage to full-hd, even CS6 helps to resize it to 1080p
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 09, 2013, 09:26:17 PM
this is good stuff! I hope it works well.
Title: Re: 550D raw video recording port official thread
Post by: carniolus on September 10, 2013, 08:27:12 AM
Would this help with Up scaling? This news just came out.

http://tv.adobe.com/watch/adobe-at-ibc-2013/after-effects-cc-detailpreserving-upscale/

Wov.This is AMAZING! Thanks for this.
Title: Re: 550D raw video recording port official thread
Post by: robinson brothers on September 11, 2013, 12:52:05 AM
No Problem.  I can't wait to try this out and Premiere CC Oct. Update will have native CDNG so you can edit RAW on the timeline and send the project file to speedgrade and back to premiere http://adobe.ly/183tLWJ
Title: Re: 550D raw video recording port official thread
Post by: synden on September 11, 2013, 11:49:10 AM
Can't find the RAW video option on the ML_550D_Dual_ISO_Aug_25_2013_Update.zip release. Anyone who can help me to enable it?
Title: Re: 550D raw video recording port official thread
Post by: glubber on September 11, 2013, 01:11:46 PM
Have you enabled the raw modules?
Then you should find it at the bottom line of the Movie menu.
Title: Re: 550D raw video recording port official thread
Post by: synden on September 11, 2013, 03:44:39 PM
Have you enabled the raw modules?
Then you should find it at the bottom line of the Movie menu.

Yeah saw it just after I posted it. Had to load the modules. Lulz. Thanks!
Title: Re: 550D raw video recording port official thread
Post by: Haeri on September 11, 2013, 06:55:28 PM
Hy everyone. This is my very first post in here so be nice pls;)

I was wondering about the whole RAW on the 550D thing. Is it even worth mentioning? - As I tested it, I was able to record with my 15mbs card somewhere about 900x300  continuously. In the hype of being able to record RAW I was about to buy the Sandisc 95mbs card. But turns out the camera internal writing speed is maxed at 21mbs. this means: The maximum resolution one can get RAW is somewhere about 1152x432. This is .. ehm... very little. So here is my point: Even though the RAW has a slighter sharper image, the H264 can go more than double the resolution (1920x1080) which makes that one RAW-sharper benefit not even worth mentioning.
Now I know that it sounds very harsh and disrespectful to those guys working on this project, which is really the opposite of what I was trying to achieve. In fact I am a big fan and was reading and using Magic lantern since the very first days.
At the end of the day we all have the same goal: to get a better looking image. But from what I can see, the RAW solution does not offer a better image quality in it's current state. So what I am trying to say is: Whats the point in shooting a squeezed VGA resolution Raw? - I know this forum is exactly about trying to make the impossible possible, but from what I have heard, I think that we have reached the limits of the 550D..
Please reply if I am wrong, because I really wish to be so.

Apologies for my bad english.
Haeri
Title: Re: 550D raw video recording port official thread
Post by: Rewind on September 11, 2013, 07:28:28 PM
Raw is not only about sharpness. It is about color detail and fidelity, dynamic range, post grade possibilities and overall feel.
I've been succesfully shooting 1200x496 (2.4:1 cinemascope) on 550d. This is the quality of an usual blue ray rip. Enough for home made demo-versions of any project.

If you really love what you're doing, you're just doing it with what you have.
Dont complaining, don't hesitate. Just go out and shoot some fu..ing raw, man.
Title: Re: 550D raw video recording port official thread
Post by: 3pointedit on September 12, 2013, 05:03:37 AM
I think that the bigger drawback is crop factor to get away from moire and false colors. I didn't really want a 4/3rds camera  :P

550d raw is great for testing but hard to shoot coverage without access to wide shots.
Title: Re: 550D raw video recording port official thread
Post by: Soupertrooper on September 12, 2013, 06:44:38 AM
I think that the bigger drawback is crop factor to get away from moire and false colors. I didn't really want a 4/3rds camera  :P

550d raw is great for testing but hard to shoot coverage without access to wide shots.

Widest I have gotten on the 550d is 16mm, with a 10-20 sigma or 10-22 canon. Moire sucks though.
Title: Re: 550D raw video recording port official thread
Post by: mine85 on September 12, 2013, 11:15:06 AM
Obligatory test footage  ;D testing exposure
Info: 550d, 50mm 1.8mm. 1728 x 786, averaging 33 frames on a Sandisk Ultra 30MB/s 32GB auto ETTR


Thanks
Title: Re: 550D raw video recording port official thread
Post by: synden on September 12, 2013, 11:39:05 AM
Hy everyone. This is my very first post in here so be nice pls;)

I was wondering about the whole RAW on the 550D thing. Is it even worth mentioning? - As I tested it, I was able to record with my 15mbs card somewhere about 900x300  continuously. In the hype of being able to record RAW I was about to buy the Sandisc 95mbs card. But turns out the camera internal writing speed is maxed at 21mbs. this means: The maximum resolution one can get RAW is somewhere about 1152x432. This is .. ehm... very little. So here is my point: Even though the RAW has a slighter sharper image, the H264 can go more than double the resolution (1920x1080) which makes that one RAW-sharper benefit not even worth mentioning.
Now I know that it sounds very harsh and disrespectful to those guys working on this project, which is really the opposite of what I was trying to achieve. In fact I am a big fan and was reading and using Magic lantern since the very first days.
At the end of the day we all have the same goal: to get a better looking image. But from what I can see, the RAW solution does not offer a better image quality in it's current state. So what I am trying to say is: Whats the point in shooting a squeezed VGA resolution Raw? - I know this forum is exactly about trying to make the impossible possible, but from what I have heard, I think that we have reached the limits of the 550D..
Please reply if I am wrong, because I really wish to be so.

Apologies for my bad english.
Haeri

In other words, it doesn't make any difference if I use a 45mb/s or a 95mb/s sd card? I will still have the same max resolution on the 550D?

EDIT: Does it matter if I have 1080p@24 or 720@50/60 with FPS override? Will the 720 make me get better resolution.
'Cause I can get the right shutter speed with 1080p@24. When I use 720p@50/60 I cant get the 180 degree shutter speed. Any ideas?
Title: Re: 550D raw video recording port official thread
Post by: kpn on September 12, 2013, 01:34:15 PM
Quote from: synden
In other words, it doesn't make any difference if I use a 45mb/s or a 95mb/s sd card? I will still have the same max resolution on the 550D?

EDIT: Does it matter if I have 1080p@24 or 720@50/60 with FPS override? Will the 720 make me get better resolution.
'Cause I can get the right shutter speed with 1080p@24. When I use 720p@50/60 I cant get the 180 degree shutter speed. Any ideas?

Yeah, it doesn't matter, because 550D internal write speed maxes out at about 21MB/s
When I set 720 in Canon menu and FPS override to 24 I can't set shutter more then 1/40 either. Don't know why.
But that way the image is a little bit squeezed but you can stretch it in AE. I get more frames recorded in 720, the only problem is the slow shutter. No idea how to fix it.
Title: Re: 550D raw video recording port official thread
Post by: glubber on September 12, 2013, 01:34:51 PM
In theory: YES!
Some are able to shoot more frames with a given resolution by using card xy from brand xyz than me.
I own a 95 mb/s and a 30mb/s from Transcend and a class 10 noname SD-Card. But no significant differnence in performance.

When using 720p be beware that the frame is squeezed in vertical resolution!
In fps override set your desired fps (i.e. 24 fps or 23.976) and choose "low jellow" for 180° shutter.

Edit: I'm not shure if its REAL 180° or somewhere near. I believe the displayed shutterspeed in screenoverlay is wrong.
 
Title: Re: 550D raw video recording port official thread
Post by: synden on September 12, 2013, 01:57:22 PM
In theory: YES!
Some are able to shoot more frames with a given resolution by using card xy from brand xyz than me.
I own a 95 mb/s and a 30mb/s from Scandisk and a class 10 noname SD-Card. But no significant differnence in performance.

When using 720p be beware that the frame is squeezed in vertical resolution!
In fps override set your desired fps (i.e. 24 fps or 23.976) and choose "low jellow" for 180° shutter.

Edit: I'm not shure if its REAL 180° or somewhere near. I believe the displayed shutterspeed in screenoverlay is wrong.

Okey, thank you so much for that information. I will try the low jellow also for the 180 shutter.
And what I can see if that if I set the camera to like 720p@60fps I can get higher resolution than if I use 1080p@24fps. Don't know, but the quality for scaling up to 720 or 1080p would be the same? Anyone who have made any tests? Otherwise I will try next week to make some tests and see if I can tell any difference.

EDIT: How much is it squeezed in vertical? How much do I need to correct for it?
Title: Re: 550D raw video recording port official thread
Post by: buffalohill on September 13, 2013, 01:39:08 PM
Not likely.

Why not?

I've been thinking the same, shouldn't monochrome be about 1/3 of the data stream of color, so in theory you should be able to go at least up to 720p continuous monochrome at 20 Mb/s, right? Maybe higher with some tricks? Any 'official' input from anyone on monochrome RAW on the 550d?
Title: Re: 550D raw video recording port official thread
Post by: kpn on September 13, 2013, 03:13:28 PM
Aright, I did some tests

Both shots are 1280x544 2.35:1

24FPS @1080 Canon Menu. 172 Frames before skipping.
http://i.imgur.com/YhKlF04h.jpg

24FPS [used Hi Jello Exact FPS to get 180 shutter] @720 Canon Menu. 2364 Frames (!!!) before skipping. Just have to stretch it vertically to get the normal dimensions
http://i.imgur.com/c7JNZe5h.jpg

720 image looks a little bit squeezed even though it's been stretched to the same dimensions. Stretched it 141% vertically. Im blown away by the increase of frames captured and thanks for the tip for achieving 180 shutter.

EDIT: I stretched it by 167% vertically to get the same exact crop as 1080.
http://i.imgur.com/y5BJZGK.jpg
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 18, 2013, 06:54:14 PM
Have you viewed the footage taken at 720p raw? I have been playing around with this for the past 2 days and the amount of moire and CA makes it pretty much unusable, but I can take more than 2000fps at 13?? something something resolution. I would only use this shoothing in a dark room...any spikes of light ruin the shot.
Title: Re: 550D raw video recording port official thread
Post by: carniolus on September 18, 2013, 07:57:52 PM
@kpn - thanks for the test. I am wondering what exactly is Hi Jello Exact FPS and where can I set it? Thanks.
Title: Re: 550D raw video recording port official thread
Post by: glubber on September 19, 2013, 08:47:13 AM
You have 3 option choosing shutterspeed with FPSoverride:

low light - almost 360° or as slow as it can get)
low jellow - 180° shutter, f.e. 1/48 s with 24 fps
hi jellow - exact fps, possibility to finetune fps and shutterspeed

for more info on shutter angle:
http://en.wikipedia.org/wiki/Rotary_disc_shutter (http://en.wikipedia.org/wiki/Rotary_disc_shutter)
Title: Re: 550D raw video recording port official thread
Post by: dafassi on September 19, 2013, 08:45:53 PM
Thank you for sharing your trys!
In 1st View both pics seems to be same.
But when you zoom a little bit you will See color artifacts.
Recording in 720p mode could give you more frames because its squeezed?
When resizing to have correct proportions you will have less quality.
Title: 550D raw video low light test
Post by: mine85 on September 20, 2013, 06:26:00 PM
A short 'short' with the intent of exploring Magic Lantern's RAW dynamic range on the 550d. ISO at 800.

Title: Re: 550D raw video recording port official thread
Post by: Adaunn on September 23, 2013, 07:56:53 AM
First test.  Just randomly shot stuff. No resizing no grades other than adobe raw adjustments. Just wish it could just give me a little more vertical resolution. I be a happy camper. Moire a bitch but I can care less at this point. Fun stuff.
https://www.youtube.com/watch?v=YfT542OlR_Q
Title: Re: 550D raw video low light test
Post by: dlrpgmsvc on September 24, 2013, 12:01:12 PM
A short 'short' with the intent exploring Magic Lantern's RAW dynamic range on the 550d. ISO at 800.

Great ! What resolution ? Thanks !  :D
Title: Re: 550D raw video low light test
Post by: mine85 on September 26, 2013, 02:56:31 PM
Great ! What resolution ? Thanks !  :D

Thanks, I shot at 1728 x 648.
Letterbox & upscale to 1920 x 1080 in Resolve (the default project settings). I was averaging approximately 41 frames per shot on a 32gb Sandisk Ultra 30MB/s
Title: Re: 550D raw video recording port official thread
Post by: dafassi on September 26, 2013, 07:42:39 PM
Can some one help me.
Why is the video not butter-smooth when panning the camera? And what can i do to make it better (before/after recording)?

Here is the RAW-Shot:

http://www.youtube.com/watch?v=6pT_54mLq0g&feature=youtu.be

Settings:
1920 mode
1152x490
low iso (200-400)
24 fps overwrite
180 degrees shutter
canon 18-135mm 3,5-5,6

recorded on a 80MB/s Class10 SDHC-CARD
Title: Re: 550D raw video recording port official thread
Post by: jagnje on September 26, 2013, 09:27:58 PM
because it`s a shaky pan?
master your tripod, move slower and more fluid. Otherwise it`s a normal look for 24 fps.
Title: Re: 550D raw video recording port official thread
Post by: dafassi on September 26, 2013, 09:35:17 PM
No ... maybe my eyes are too sensible :D but its not the shakyness of my hands.
For me it "feels" like a 20fps-clip rendered with 24fps ... like some frames are missing to have a real smooth motion or the motion blur is not correct.
Title: Re: 550D raw video recording port official thread
Post by: Adaunn on September 27, 2013, 05:45:34 AM
I tried doing 2.5k and got about 20 frames or so. Can't remember. My SD card is a Sony brand maxing out at 19mbs. But I got about one second at 1728 x 1152 at 14 frames. The quality is amazing and I just wish this camera could squeeze a few extra seconds at 24 frames. Neat no matter what. It's been fun but because of the camera's hardware limitations I can't really use it's raw feature for my regular work.
Title: Re: 550D raw video low light test
Post by: dafassi on September 28, 2013, 12:35:24 PM
A short 'short' with the intent of exploring Magic Lantern's RAW dynamic range on the 550d. ISO at 800.


WOW like that mine85!

Why is everything so smooth? I mostly have stroboscobic effects. 24p/180° ?
Title: Re: 550D raw video recording port official thread
Post by: prabhath.mp on September 29, 2013, 02:56:52 PM
Hi All,

Could anyone let me know if the SDHC card mentioned below is compatible for installation of RAW firmware for 550D?

http://www.flipkart.com/item/ACCDAW7EBVCZ87EA

Also, I have a 16GB Class 10 30MBps SanDisk SDHC.

Is that compatible for RAW?

Please suggest some good card that has proven to be worth buying for the propose?

Thanks so much
Title: Re: 550D raw video recording port official thread
Post by: mine85 on September 29, 2013, 05:42:16 PM
Can some one help me.
Why is the video not butter-smooth when panning the camera? And what can i do to make it better (before/after recording)?

Here is the RAW-Shot:

http://www.youtube.com/watch?v=6pT_54mLq0g&feature=youtu.be

Settings:
1920 mode
1152x490
low iso (200-400)
24 fps overwrite
180 degrees shutter
canon 18-135mm 3,5-5,6

recorded on a 80MB/s Class10 SDHC-CARD

@dafassi Have you tried recording without the fps override?
Title: Re: 550D raw video recording port official thread
Post by: dafassi on September 29, 2013, 05:55:46 PM
Hi All,

Could anyone let me know if the SDHC card mentioned below is compatible for installation of RAW firmware for 550D?

http://www.flipkart.com/item/ACCDAW7EBVCZ87EA

Also, I have a 16GB Class 10 30MBps SanDisk SDHC.

Is that compatible for RAW?

Please suggest some good card that has proven to be worth buying for the propose?

Thanks so much

Yes it is! I use the same card with 32GB and it works very good!


@dafassi Have you tried recording without the fps override?

Nope i never tryed this ... is the relevant for 24FPS in finished movie? I think when i have more frames they will be droped- and when i have less frames the stroboscobic-effect will be more intensive? Wrong?

BUT i have to say- yesterday in the cinema a took a deeper look to the screen and was wondering how much stroboscobic lighting is there!
I never saw this before, maybe because i didnt make 24p shots before :D.

The intersting question is- why does this come? Is it the lighting of objects, is it the aperature setting, is it dof?
Yes i know it has to do with the camera sensor- i mean what is the trick to reduce this effect?

I found out that edges from objects has much less strobosobic effect when there is less light in the background.
This would me, i need a way to have a stronger motionblur on intensive contrasted-areas. Is that right?
How to reduce this effect? Specialy in the scene i attached- what could i do better EXCEPT using a TRIPOD?

THANKS!
Title: Re: 550D raw video recording port official thread
Post by: Rewind on September 29, 2013, 06:26:40 PM
@dafassi, this stroboscopic effect you are talking about is inavoidable in 24fps shooting. It is always there in all the movies. But! You will almost never see the scene like yours in movies. It is always there is an Object in the scene which stays in frame and picks all your attention. All the pans DP doing are done with some purpose. There are no just pans in movies. It's always a following the object in foreground. And the foreground is the place, where the action happens.
Directing of photography is an art. You obviously just can't pan whatever you want.
24fps is an art. An art of capturing just the information you need as a director, and not All of the information. The less is more of some kind.

But what you can do to avoid this effect is just increase the fps. Use 30 fps for example, it will be much better, but it will look like video, not like film anymore.
Title: Re: 550D raw video recording port official thread
Post by: dafassi on September 29, 2013, 06:38:46 PM
Rewind thank you!
Thought the same when i saw the movie in the cinema yesterday.

Great- the eos550d is a movie-camera :D, thanks to the ML-Team for that wonderful thing!
Title: Re: 550D raw video recording port official thread
Post by: prabhath.mp on September 30, 2013, 10:00:14 AM
Hi,

Thank you so much for your reply.
Does 550D support a 64GB (or more) capacity SDHC card for recording RAW?

Which brand is optimum/reasonable.

Thanks again
Title: Re: 550D raw video recording port official thread
Post by: Alex546 on September 30, 2013, 01:28:41 PM




Thank you for the raw module :)


Please enjoy your new colors:
(No color correction)



SD Card: Transcend SD HC 32 GB
1920p mode
FPS override:23.9 fps
Raw Res: 1344x610 (Upscaled with Instant HD)
max 96 frames
Title: Re: 550D raw video recording port official thread
Post by: prabhath.mp on September 30, 2013, 07:20:15 PM
Hi Alex,

Could you please provide more information about your SDHC card that was used to record RAW video (I know it's Transcend, however, I could not find details about class; MBps and others) :)

The results are awesome. Also, could you let me know if 550D supports 64GB memory card for recording in RAW?

I am particularly looking for the model in this link: http://www.flipkart.com/item/ACCDAW7EBVCZ87EA




Thank you for the raw module :)


Please enjoy your new colors:
(No color correction)



SD Card: Transcend SD HC 32 GB
1920p mode
FPS override:23.9 fps
Raw Res: 1344x610 (Upscaled with Instant HD)
max 96 frames
Title: Re: 550D/T2i raw video recording port official thread
Post by: dafassi on October 01, 2013, 04:58:30 PM
This is my 1st RAW-Clip.
To give you the best quality i uploaded the 200MB-File to my homepage.
I know- its shaky handeld.

http://df-vfx.de/?post_type=videogallery&p=111 (http://df-vfx.de/?post_type=videogallery&p=111)

Loading may take a while if you have low speed conections.
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 01, 2013, 07:14:18 PM
Hi All,

Does 550D support 64GB card? http://www.flipkart.com/item/ACCDAW7EBVCZ87EA

In most posts I have only come across 32GB Memory cards; please could anyone advise?

After reading information in this thread, I understand that the camera's hardware does not support write speed beyond 20MBps. So according to my understanding, any SD Card that has speed greater than or equal to 20MBps should give optimum results (please correct me if I am wrong here) :)

The one I am considering to purchase is a SanDisk Ultra SDXC 64 GB 30MB/S Class 10 Memory Card (please follow link above).

Would appreciate all your help/advice/suggestions in this regard.

Cheers,
Prabhath MP

Bangalore, India
Title: Re: 550D/T2i raw video recording port official thread
Post by: Klask on October 02, 2013, 05:35:50 PM
Hi All)
Who know, what t2i maximum write speed?
I have SanDisk Extreme Pro card with 90MB/s write speed and 95MB/s read speed, but during the record i take bufferoverload and 20MB/s max speed..
Title: Re: 550D/T2i raw video recording port official thread
Post by: Rewind on October 02, 2013, 05:38:23 PM
Hi All)
Who know, what t2i maximum write speed?
I have SanDisk Extreme Pro card with 90MB/s write speed and 95MB/s read speed, but during the record i take bufferoverload and 20MB/s max speed..
You answered your question. By the way, take a look at this: http://www.magiclantern.fm/forum/index.php?topic=6215.0
Title: Re: 550D/T2i raw video recording port official thread
Post by: Klask on October 02, 2013, 07:09:24 PM
You answered your question. By the way, take a look at this: http://www.magiclantern.fm/forum/index.php?topic=6215.0
Oh.. Thanks a lot)..
Well. I'm selling out my t2i)
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 03, 2013, 03:02:11 PM
Hey, guys
does 550D support UHS-I cards?
What is the best SDHC for Raw Video to buy? Which parameter is more important (read/write speed)?
I look on these cards:
SanDisk SDHC HD Video 32GB eXtreme Class 10 read/write :30/30 (cost 50 euro)
Kingston SDHC 32GB Class 10 read/write :60/35 (cost 42 euro)
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 03, 2013, 08:57:31 PM
Hi All,

Hope you're well.

I still haven't been able to decide on best (effective/efficient) SD card for 550D.

Could anyone please help me?

Hope to hear from you soon.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: Rewind on October 03, 2013, 09:08:10 PM
Whatever card with write speed faster than 20Mb/s will work fine.
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 04, 2013, 08:58:31 PM
Hello All,

Has anyone being using Transcend Card?
http://www.flipkart.com/item/ACCCZ4FFCENSFKG2

32GB SDHC 20MBps Class 10

Is it suitable for RAW?

Please reply.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 04, 2013, 10:01:24 PM
Hello All,

Has anyone being using Transcend Card?
http://www.flipkart.com/item/ACCCZ4FFCENSFKG2

32GB SDHC 20MBps Class 10

Is it suitable for RAW?

Please reply.

Cheers,
Prabhath MP

Hi
I'm using Team 20Mbps card class 10 and continuos record works on 960x540 23.97fps
1280 wide provide ~60-65 frames
Next week I'll get SanDisk 32mb 30Mbps eXtreme Pro and test it for speed ^_^
Maybe this info help
Title: Re: 550D/T2i raw video recording port official thread
Post by: telecastDaveRI on October 05, 2013, 05:16:35 AM
Hello All,

Has anyone being using Transcend Card?
http://www.flipkart.com/item/ACCCZ4FFCENSFKG2

32GB SDHC 20MBps Class 10

Is it suitable for RAW?

Please reply.

Cheers,
Prabhath MP

It should be fine. I wouldnt get too caught up on brand names or write speeds. As Rewind mentioned, as long as it is around or faster than 20mbps, you are fine. Definitely stick with the class 10 cards though.
Title: Re: 550D/T2i raw video recording port official thread
Post by: Rewind on October 05, 2013, 08:46:45 AM
It should be fine. I wouldnt get too caught up on brand names or write speeds. As Rewind mentioned, as long as it is around or faster than 20mbps, you are fine. Definitely stick with the class 10 cards though.

Yes, but... I have one of these Transcends, and it's real writing speed is about 11-12 Mb/s. So my advise is to search the web for speed tests.
Title: Re: 550D/T2i raw video recording port official thread
Post by: 3pointedit on October 05, 2013, 08:57:09 AM
Sorry if this has been answered many times before, but why do i get more recorded frames from standard FOV (with aliasing) but fewer frames from the 5x cropped (1:1)?
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 05, 2013, 08:15:19 PM
Hi All,

Thank you so much for the reply :)

I ordered for a 32 GB SanDisk SDHC Class 10 20MBps (I have a 16GB of the same variant and I found it useful for RAW).

:) I am finding it difficult for a workflow on Ubuntu 13.04, however! If any of you guys are using Ubuntu 13.04 please provide your suggestions regarding workflow.

I installed WIne and downloaded RAW2DNG.exe (for Windows). But finding it difficult to decipher the RAW file.

Thanks once again.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: BrotherD on October 07, 2013, 05:56:43 AM
Hi All,

Thank you so much for the reply :)

I ordered for a 32 GB SanDisk SDHC Class 10 20MBps (I have a 16GB of the same variant and I found it useful for RAW).

:) I am finding it difficult for a workflow on Ubuntu 13.04, however! If any of you guys are using Ubuntu 13.04 please provide your suggestions regarding workflow.

I installed WIne and downloaded RAW2DNG.exe (for Windows). But finding it difficult to decipher the RAW file.

Thanks once again.

Cheers,
Prabhath MP
Try raw2cdng version 1.30. Search for it on this site. It's easy to use.
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 09, 2013, 02:47:07 PM
Some 18-55mm kit lens action  :) lot's of moiré but that's expected.
CinemaDNG grading done in Resolve with Dennis Schmitz' excellent Teal/Orange LUT: http://bmcuser.com/showthread.php?4929-NEW-Lut-TealOrange
Title: Re: 550D/T2i raw video recording port official thread
Post by: wolf on October 09, 2013, 04:47:40 PM
Very relaxed sound but the video should be longer.  ;)
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 09, 2013, 06:39:32 PM
Very relaxed sound but the video should be longer.  ;)

Thanks, I know ;D but I thought I'd rough up a short fast test to see how the T2i dng's handle LUTs in Resolve.
Title: Re: 550D/T2i raw video recording port official thread
Post by: dlrpgmsvc on October 10, 2013, 08:56:46 PM
Some 18-55mm kit lens action  :) lot's of moiré but that's expected.
CinemaDNG grading done in Resolve with Dennis Schmitz' excellent Teal/Orange LUT: http://bmcuser.com/showthread.php?4929-NEW-Lut-TealOrange

At 0:15 the car is hiccupping ! What's the problem ? It's not my player...
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 11, 2013, 05:02:37 AM
Evening friends.

Note:  Im new to the forum, but not to video/audio production.  If I post something, its because I'm either contributing or I have "searched" and do not have the answer.

That said, I've been following this thread for a while, and decided to cross over to the dark side and grab a dev build for the 550D.

My setup:

Camera:  Rebel T2i, Sandisk 32GB Class 10 card that writes theoretically at 30 mps.
Computer:  2010 Mac Mini dual proc 2.33Ghz, 8GB RAM
Software:  RAW2DNG Utility, Adobe Lightroom 5, FCPX 10.0.0.9, ML build 11174 (noted on the first page of this thread, last entry on the builds section)

So, I was able to "record in RAW", but only at 960x540 at 14 FPS...but it stopped automatically after 10 seconds.   Booooo.....

My question is this:  What settings must I use for the RAW recording module to get 960x540, so I can record continuously at 24FFPS without stopping?

I set the FPS over ride to 14 FPS just to start, using "EXACT FPS" option in the sub menu.  Ideally, I'd like to be able to record 2-3 minutes.

The rest is easy.  I was able to export using RAW2DNG utility, import into Lightroom, and take advantage of all the RAW editing options in Lightroom.  Exporting was just as easy, as well as adjusting in FCPX.

If anyone has answers this this problem, I'd appreciate it.  What I'd like to do to give back, is once I know I can record without stopping, write up a small tutorial on the whole process so folks can follow along, soup-to-nuts, and be able to achieve similar success. 

Im very familiar with the 2.3 ML Stable package, but if we can understand the settings required for RAW....it would be so awesome.

Thanks all.  If anyone has questions on Lightroom 5 or FCPX working with this material, please hit me up.

Cheers,

Yoda
550D
Lenses:  18-55mm IS, 40mm 2.8 USM, EF-L 17-40mm USM f4.0, 50mm f1.4 USM, 50-250mm IS
Software:  FCPX, Logic Pro 9, Adobe Lightroom 5, Motion 5, RAW2DNG, EOS Utility
Hardware:  Rode NT-1A, Mac Mini, Yamaha RX-V3800, Paradigm Studio v5 Towers (biamped), Green Screen
Title: Re: 550D/T2i raw video recording port official thread
Post by: BrotherD on October 11, 2013, 07:36:09 AM
Evening friends.

Note:  Im new to the forum, but not to video/audio production.  If I post something, its because I'm either contributing or I have "searched" and do not have the answer.

That said, I've been following this thread for a while, and decided to cross over to the dark side and grab a dev build for the 550D.

My setup:

Camera:  Rebel T2i, Sandisk 32GB Class 10 card that writes theoretically at 30 mps.
Computer:  2010 Mac Mini dual proc 2.33Ghz, 8GB RAM
Software:  RAW2DNG Utility, Adobe Lightroom 5, FCPX 10.0.0.9, ML build 11174 (noted on the first page of this thread, last entry on the builds section)

So, I was able to "record in RAW", but only at 960x540 at 14 FPS...but it stopped automatically after 10 seconds.   Booooo.....

My question is this:  What settings must I use for the RAW recording module to get 960x540, so I can record continuously at 24FFPS without stopping?

I set the FPS over ride to 14 FPS just to start, using "EXACT FPS" option in the sub menu.  Ideally, I'd like to be able to record 2-3 minutes.

The rest is easy.  I was able to export using RAW2DNG utility, import into Lightroom, and take advantage of all the RAW editing options in Lightroom.  Exporting was just as easy, as well as adjusting in FCPX.

If anyone has answers this this problem, I'd appreciate it.  What I'd like to do to give back, is once I know I can record without stopping, write up a small tutorial on the whole process so folks can follow along, soup-to-nuts, and be able to achieve similar success. 

Im very familiar with the 2.3 ML Stable package, but if we can understand the settings required for RAW....it would be so awesome.

Thanks all.  If anyone has questions on Lightroom 5 or FCPX working with this material, please hit me up.

Cheers,

Yoda
550D
Lenses:  18-55mm IS, 40mm 2.8 USM, EF-L 17-40mm USM f4.0, 50mm f1.4 USM, 50-250mm IS
Software:  FCPX, Logic Pro 9, Adobe Lightroom 5, Motion 5, RAW2DNG, EOS Utility
Hardware:  Rode NT-1A, Mac Mini, Yamaha RX-V3800, Paradigm Studio v5 Towers (biamped), Green Screen
Yoda, I just did a quick settings test of 960x540, fps override 23.97 and 16x9 framing. The results were continuous shooting. In your camera scroll to raw video, click the Q button (next to WB) then change the framing. You will see the write speed, in green letters, change at the bottom of the screen. Mine read 960x540 (16x9), in white letters and 20.7 MB/s at 23.97 in green letters.

 Read through this thread's 44 pages and you will get answers and be blessed by all the work the Magic Lantern team and others have put into shooting raw!
Title: Re: 550D/T2i raw video recording port official thread
Post by: Rewind on October 11, 2013, 08:45:07 AM
So, I was able to "record in RAW", but only at 960x540 at 14 FPS...but it stopped automatically after 10 seconds.   Booooo.....

My question is this:  What settings must I use for the RAW recording module to get 960x540, so I can record continuously at 24FFPS without stopping?

First, you should perform the card benchmark.
Go to ML menu — Debug — Benchmarks — Card R/W benchmark (5 min)

For me it's obvious, your card is too slow.
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 11, 2013, 01:48:06 PM
Tried the benchmark.  Camera shuts off after a few frames.  Looks like a bug to me.

Did some research....the 550d has a hardware limit of 20mps.  The card I got says it can write up to 30mps, and it's a class 10.

What is the latest build that is stable?  I'm hesitant to grab the last "nightly build".  Can anyone share which build is working for them?  Also, what card they are using?

Also, if you have a theory....please provide some context in terms of being able to me dre the value of your theory.  Otherwise...ur just guessing.  System Engineers like myself have little fanfare for such bullocks.

Cheers,

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 11, 2013, 01:53:27 PM
Scratch my comment on debug.  My auto off was set at 30 seconds.  Terribly embarrassing.

I'll post the results after.

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 11, 2013, 02:16:54 PM
Yoda, I just did a quick settings test of 960x540, fps override 23.97 and 16x9 framing. The results were continuous shooting. In your camera scroll to raw video, click the Q button (next to WB) then change the framing. You will see the write speed, in green letters, change at the bottom of the screen. Mine read 960x540 (16x9), in white letters and 20.7 MB/s at 23.97 in green letters.

 Read through this thread's 44 pages and you will get answers and be blessed by all the work the Magic Lantern team and others have put into shooting raw!

What card r u using?

My benchmark is running....and the results are consistent thru 5/9 tests so far.

Write speed = 8.9-9.1 MB/s
Read speed = 20-21.1 MB/s

Disappointing to say the least.  From this thread....it sounds like I need something in excess of 20 MB/s.

Anyone use an SDXC card?  Obviously CF won't work.

Cheers again,

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: glubber on October 11, 2013, 04:42:46 PM
"Write speed = 8.9-9.1 MB/s"

are you reffering to the 2nd last row in the benchmark?
I have the same SD-card as below and never had problems with recording raw-videos in 960x540.

Btw. u can use the latest nightly w/o fear  ;D

http://builds.magiclantern.fm/jenkins/job/550D.109/67/artifact/platform/550D.109/magiclantern-v2.3.NEXT.2013Oct11.550D109.zip (http://builds.magiclantern.fm/jenkins/job/550D.109/67/artifact/platform/550D.109/magiclantern-v2.3.NEXT.2013Oct11.550D109.zip)

(http://dl.dropboxusercontent.com/u/81225910/card-benchmark.jpg)


(http://dl.dropboxusercontent.com/u/81225910/transcend.jpg)
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 11, 2013, 05:01:54 PM
When running the bench mar, it goes thru 9 phases.  At each stop it show my Read Speed and Write Speed for each block the test runs on.  Usually the write speeds were 9.1 MB/s, and read speeds around 20 MB/S.

I also wonder (although doubt) if when using Exposure Override is ON, if any of the additional ISO/Aperture/White Balance settings could contribute to buffer over load causing a crash?

Either way, Im a fan of nightly build now, and will download the latest after Im done with work.  Tech by day, Tech by Night, lol.

Sidenote:  If any of you have never used RAW2DNG for Mac, it is an awesome utility and works lightning fast.  Free to obtain.

Sidenote2:  Post grading DNG files in Adobe Lightroom 5 is equally as fast.  Exported in uncompressed TIFF.

Sidenote3:  IF anyone needs help importing/exporting in FCPX, please message me.  I was able to do this fairly easy, and since color grading is already done, the export process with rendering OFF (meaning NO optimized media) was suprisingly efficient and fast.

Sidenote4:  Found some 5DMK2 camera for $800 on ebay.  Shutter life is 350K actuations.  Since the frame size is much better on these cameras, for those who can afford it, it might be a good idea to invest in one since it's full frame, and a fraction of cost of new 6D.

Cheers.

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 11, 2013, 08:11:08 PM
Hi All,

Hope you're well

I tired to record RAW on lower resolution and it worked fine. But when I increased resolution, it records few frames and stopped.

What is the optimum setting to record continuously with a little extra resolution?
Title: Re: 550D/T2i raw video recording port official thread
Post by: fxPPC on October 11, 2013, 09:10:49 PM
As lon as you are using a card that can do 20 MB/sec (the limit of the camera) you can do:

16:9  960x540  (this is pushing the camera to its max. don't count on more than 3-4 minute takes)

anything larger and the running time your takes can be plummets.
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 12, 2013, 02:17:34 AM
Ok, just bought this:

http://www.amazon.com/SanDisk-Extreme-Class-Memory-SDSDXPA-032G-AFFP/dp/B007NDL56A

I'll report back on write speed from benchmark and real life test.  #excited

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 12, 2013, 02:37:51 AM
Success!

Maxed out write speed at 19.9 MB/s, read speed at 21.1 MB/s.

Was able to record 960x540 16:9 for days.

Tonight I used the EF 50mm 1.4 USM lens for a low light test, but tomorrow, I will take out my 17-40MM EF-L for some wide screen shots in the sunshine by the park.  With the zoom, I should be able to get some nice pics, and in addition, perhaps try some 2.35:1 shots to get some near anamorphic videos.

Fyi, Best Buy is doing price matching.  This card I bought was listed at $97.99, and it is on B&H Photo for $60.67.  Got $30 off.  Good stuff.

Cheers.

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 12, 2013, 06:06:03 AM
Here is my first video from RAW.  Be sure to watch on "1080P" mode.  Video can be watched at full screen resolution.

http://www.youtube.com/watch?v=MVrrXbsbJiU

Workflow:

Shot at 960x518 2.35:1 ratio, 23.997fps.  RAW file converted to DNG files via RAW2DNG.  Files imported into Adobe Lightroom 5.  Processed one frame, then "sync'd" to rest of frames to have consistent post-processing/color grading.  Exported all frames (all 1879) to .TIFF format.  Created FCPX project at SD 960x540, 23.997fps.  Imported frames into event & project.  All frames set to duration of 00:01.  Created compound clip for grouping.  Exported to "Master File" at Prores 422.  Created 2nd FCPX project at 1080p, 23.997 fps.  Imported "Master File" and resized to 60%.  Exported to 1080p H.264 codec, uploaded to Youtube.  Voila!

I will say this video, shot at ISO 1050, Aperture 1.4, Shutter speed 1/24 (359 degree), had tons of noise prior to processing in Lightroom.  Regained so much of the shadows, and increasing the clarity/vibrancy, using "Luminance" to reduce noise helped tons.

That said, for this one minute video, FCPX was the biggest RAM hog and slow to operate.  My system is dual core,  2.33GHZ with 8GB RAM.  Not the greatest, but not too shabby for a 2010 Mac Mini.  Still beats purchasing an EOS C-100.

As a lesson learned, I might try to export DNG files to .JPG next time.  .TIFF files are huge.  1897 frames with .TIFF amounted to 5GB in files that had to be imported into FCPX.  Grr.....

No sound carried over though.  Will have to explore a mobile sound setup for the future.

Cheers,

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 12, 2013, 04:29:38 PM
Something for folks to consider.  It is possible to use a 1280x720p workflow with the 550D.  The camera CANNOT record 1280x720p continuos at 24fps, but it CAN record 1280x426 at 24fps (3:1 aspect ratio) for just over a minute.

This is really awesome, because recording in a 3:1 or a 2.67:1 aspect ratio provides the ability to essentially record native anamorphic.  When the RAW file is converted to image sequences, you have a bunch of DNG files at 1280x720.  These files, which in turn, are then imported into an editor like Final Cut Pro or Adobe Premiere, will natively display in "anamorphic"....IF YOU SET YOUR PROJECT to 1280x720p.  This is HUGE...because it means no rendering of any "letterbox" type of effects, and you aren't losing video like you would with a letterbox effect.

Also, for those with slower computers, I highly recommend using .JPG vs. .TIFF when exporting after the color grading in your photo software (e.g. Lightroom, Photoshop, etc).  I exported a set of DNG files to.JPG at 80% quality, and each file came to 637kb.  This is great for the import/stitch process when using your movie software...as the file footprint is not nearly as huge (i.e. less RAM used, faster computer and export processing).  But...the trade off is some loss in image quality (not lots but some).  Still....native anamorphic with color grading IMHO is better than using .h264 standard codec with 720p on the camera board.

If you have the guts and patience, then using .TIFF is the only way to go.  The image quality is top notch.  Just takes a while to render during the import process (regarding your movie software).

For rich folks, Im sure a Mac Pro quad core with 16GB RAM would eat this stuff up alive. 

Cheers.

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 14, 2013, 10:14:51 AM
Hello guys!
Tested SanDisk 32Gb eXtreme Pro 45Mbps
Lenses: Vivitar 24mm f/2.0 for Nikon, Helios 44-2 58mm /f2.0, Jupiter-37A 135mm f/3.5
Aspect ratio 2.35:1
Resolution 1280x544 ~86 frames, 1600x680 ~64 frames
Ginger HDR was used for working with RAW in Ae and Pr
http://vimeo.com/76848688

Just wonder why is there flickering white lines? is it bad anti-aliasing?
And what do you think about Color Grading?
Title: Re: 550D/T2i raw video recording port official thread
Post by: ItsMeLenny on October 14, 2013, 12:37:01 PM
Tested SanDisk 32Gb eXtreme Pro 45Mbps

45Mbps won't matter as the 550D caps at 21Mbps

I couldn't see the flickering white lines. But a discussion on that should probably be started in the Videos section.
Same with colour grading, looked alright (as in good), not my style to be honest so I can't offer any constructive criticism.
(Maybe give it a bit more contrast, use your video scopes to help out).
In fact, maybe the contrast was fine in most parts, some parts were just over exposed, particularly the slug.
Title: Re: 550D/T2i raw video recording port official thread
Post by: 3pointedit on October 14, 2013, 12:44:37 PM
While I love the colour depth and lack of compression artifacts I find to many pink frames. I don't see the point in 550d RAW sadly. It's back to h264 for me.
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 14, 2013, 12:59:10 PM
Thx guys!
In comparison to h.264 - raw a little bit sharper with lot of detail, but for 550d it's hard to shoot in raw. Thinking about 6d
Title: Re: 550D/T2i raw video recording port official thread
Post by: FailedRenegade on October 14, 2013, 04:48:30 PM
Resolution 1280x544 ~86 frames, 1600x680 ~64 frames

I have the exact same card that you tested and I'm getting ~180 frames @ 1280x544. Using a nightly build from 29th Sept (haven't bothered to update it since)
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 14, 2013, 06:38:15 PM
I have the exact same card that you tested and I'm getting ~180 frames @ 1280x544. Using a nightly build from 29th Sept (haven't bothered to update it since)
my mistake, ~165-170 frames at 1280x544
anyway we need more ^_^
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 14, 2013, 10:12:37 PM
Hi All,

Good day to all of you.

I was wondering if anyone has tried to project video (both default video and RAW) on to a large screen?

What's the probability of it retaining details, provided the action was directed and captured in a controlled environment?

Also, if one was to use combination of native video and RAW, would that cause any visible difference in quality?

I was thinking of capturing in 16:9 aspect (both native and RAW) since the native video is captured in 16:9 ratio.

Thanks for your suggestion/advice in this regard.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 15, 2013, 08:42:55 AM
Here's an example of RAW lying over h.264
as you may see RAW is more detailed and sharper. Just compare the car numbers :)
(http://gyazo.com/fe304eee1dfcc54e5468f80268817c9d.png)
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 15, 2013, 11:04:15 AM
Hi Coolerinc,

Thank you for providing the details below :)

Here's an example of RAW lying over h.264
as you may see RAW is more detailed and sharper. Just compare the car numbers :)
(http://gyazo.com/fe304eee1dfcc54e5468f80268817c9d.png)

I still have a question, however:-

According to my understanding 550D cannot record RAW frames in 1920 X 1080 resolution.

So, even if we were to compare 1080 H.264 and the RAW frame, we will have to probably crop the H.264 video frame to match the RAW (or we may have to upscale the RAW frame to match 1080).

Could you please let me know how was the result achieved in your test, below? :)

If the RAW frame recorded in lower resolution would give such amazing results when scaled to 1920 X 1080 then recording in RAW would certainly be awesome :)

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: ItsMeLenny on October 15, 2013, 11:56:58 AM
According to my understanding 550D cannot record RAW frames in 1920 X 1080 resolution.

So, even if we were to compare 1080 H.264 and the RAW frame, we will have to probably crop the H.264 video frame to match the RAW (or we may have to upscale the RAW frame to match 1080).

Could you please let me know how was the result achieved in your test, below? :)

If the RAW frame recorded in lower resolution would give such amazing results when scaled to 1920 X 1080 then recording in RAW would certainly be awesome :)

You've got it a bit wrong.

The max res on 550D is 1728x1156, but this is the whole sensor. So it would covers the same area as the 1920 resolution.

The 1920x1080 res is scaled up to that res in camera, it records at a smaller res and stretches it, that's why 1920 looks terrible.

So no crop is needed to get the same image, unless you shoot at a smaller raw res.
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 15, 2013, 12:31:54 PM
If the RAW frame recorded in lower resolution would give such amazing results when scaled to 1920 X 1080 then recording in RAW would certainly be awesome :)
As I noticed 1280x544 upscaled to 1920x1080 is almost the same with quality but with raw you get about 12 stops for grading.
In the picture above I shoot at 1600 with upscaling 112% to match 1920x1080
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 15, 2013, 01:32:44 PM
Hi All,

Thank you so much for your reply.

I use a Sandisk 32GB; 20MBps; Class 10 Memory card and whenever I tried to capture RAW in higher resolutions, it stops recording after few seconds.

You've got it a bit wrong.

The max res on 550D is 1728x1156, but this is the whole sensor. So it would covers the same area as the 1920 resolution.

The 1920x1080 res is scaled up to that res in camera, it records at a smaller res and stretches it, that's why 1920 looks terrible.

So no crop is needed to get the same image, unless you shoot at a smaller raw res.

Has anyone tried to capture RAW frames in 550D full capacity? How successful has it been. I am not quite sure if my card supports such huge resolution.

Also, could anyone suggest an optimum resolution where I can get continuous record (for at least 3 to 4 minutes).

Which nightly build has been more successful on delivering best results for RAW so far? I downloaded the one that was created on 09-Oct-2013.

Thanks so much for your help on this :)

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 15, 2013, 02:03:53 PM
Has anyone tried to capture RAW frames in 550D full capacity? How successful has it been. I am not quite sure if my card supports such huge resolution.

Also, could anyone suggest an optimum resolution where I can get continuous record (for at least 3 to 4 minutes).

Which nightly build has been more successful on delivering best results for RAW so far? I downloaded the one that was created on 09-Oct-2013.

At 1728 you'll be able to capture about 30 frames
For continuous record 960x540 is optimum
I'm using 25-Aug-2013 build
For more info check this thread (http://www.magiclantern.fm/forum/index.php?topic=6215.0)
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 15, 2013, 03:00:49 PM
Hi Coolerinc,

Thank you so much for your reply buddy :)

At 1728 you'll be able to capture about 30 frames
For continuous record 960x540 is optimum
I'm using 25-Aug-2013 build
For more info check this thread (http://www.magiclantern.fm/forum/index.php?topic=6215.0)

Will certainly try as suggested, probably during this weekend and will get back with an update on my results.

Also, have you tried to project video on to a large screen (like in movie theatres). On a scale of 1 to 10 (1 being least and 10 being best) how would you rate about quality of RAW video processed after grading and projected on Large Screen?

I know the quality will not be anywhere close to the large sensor cameras, however, still I'm hoping/assuming that the quality will be considerably good (Please correct me if I am wrong).

Thanks so much once again.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 15, 2013, 03:43:05 PM
Also, have you tried to project video on to a large screen (like in movie theatres). On a scale of 1 to 10 (1 being least and 10 being best) how would you rate about quality of RAW video processed after grading and projected on Large Screen?

I know the quality will not be anywhere close to the large sensor cameras, however, still I'm hoping/assuming that the quality will be considerably good (Please correct me if I am wrong).

Didn't try to project on to the theater screen but I think the quality of RAW 1600x680 2.35:1 will be fine. BTW people in the theater don't sit too close to the screen :)
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 15, 2013, 04:00:44 PM
Didn't try to project on to the theater screen but I think the quality of RAW 1600x680 2.35:1 will be fine. BTW people in the theater don't sit too close to the screen :)

Certainly agree with your point here :)

Was just curious to know if anyone had tried to project that on to a large screen.

I was thinking of recording in 960 X 540 (16:9 aspect ratio); Combine them with few H.264 shots (where lighting is controlled); Crop them to 2.35:1; I was just wondering how it would appear on large screen :-\

Your posts were very helpful, however :)

Will try 1600 X 680 (2.35:1 Cinema aspect), but not sure if my card is capable to handling such resolution.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: NattyNick on October 15, 2013, 05:20:42 PM
Hey guys,

Long time lurker, I've been reluctant to try shooting Raw as I produce documentaries, so measuring the length of time I can film in frames didn't excite me very much. 12 minutes isn't even long enough, but it's the right amount of time to be able to control when to stop and start again (aim for a question as that's not a necessary part of the film)

Anyway I decided to try Raw with my 550D the other day, trying the continuous 960x540, 16:9. I was half impressed, but the work flow seemed to slow everything down so much it, the payoff didn't seem worth it. Granted, if I shot in a higher resolution I might be thinking differently, but I'm not sure if the pros are worth the sacrifice in the recording time, cropping, resolution and post workflow. I mean, if you light a scene properly and know the limits of the camera and how to use it, then h.264 isn't that bad.

I'd love to be proven wrong though, maybe my settings and workflow are the issue?

Record at 960x540 16:9
Copy all media to desktop and use RAW2DNG to convert each shot (this step took ages since it also creates the ProRes files... but they're useful so I wouldn't want to do the process without them)
GingerHDR into AE to grade and make any other adjustments and make a rough cut, then InstantHD to 1080p
Import AE sequence into Premiere to make last minute changes and add some sound
Export at 1080p for Youtube

RESULT:

Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 15, 2013, 06:45:09 PM


RESULT:





Hi NattyNick,

The video seemed to be good to me. Any idea if there will be any difference if we export images as .TIF format?

I use Blender for grading and post-production of video and unfortunately Blender does not support .DNG file format :(

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 15, 2013, 10:44:33 PM
Good question.  I used a workflow and exported to both JPG and .TIFF.  HUGE DIFFERENCE.  You can see it in the overal picture quality, really shows up in lines.  But, it alos depends on what you are going for.  If you arent shooting art, or something that requires clean/soft presentation, you can get away with JPG even at 80% quality (20% compression).

As for the color...again, using TIFF just makes everything look better, especially in low light shots.

At this point, shooting RAW on 550D is easy.  The key is obviuosly a really fast SDHC or SDXC card, and a post production setup that allows a streamlined workflow.  The only real decision to make is the frame size (1280x544, 960x540, etc).  One doesn't need continuous FPS to get good shots.  24fps at 10 seconds is 240 frames recorded.  More than enough to do get good shots, and move from subject to subject, shot to shot, etc.

In terms of "post processing", speed can be obtained by switching to an SSD drive, getting more RAM, and having minimum 2 procs, preferably 4 proc setup.

Cheers.

Yoda

Title: Re: 550D/T2i raw video recording port official thread
Post by: BrotherD on October 16, 2013, 01:44:52 AM
Hey guys,

Long time lurker, I've been reluctant to try shooting Raw as I produce documentaries, so measuring the length of time I can film in frames didn't excite me very much. 12 minutes isn't even long enough, but it's the right amount of time to be able to control when to stop and start again (aim for a question as that's not a necessary part of the film)

Anyway I decided to try Raw with my 550D the other day, trying the continuous 960x540, 16:9. I was half impressed, but the work flow seemed to slow everything down so much it, the payoff didn't seem worth it. Granted, if I shot in a higher resolution I might be thinking differently, but I'm not sure if the pros are worth the sacrifice in the recording time, cropping, resolution and post workflow. I mean, if you light a scene properly and know the limits of the camera and how to use it, then h.264 isn't that bad.

I'd love to be proven wrong though, maybe my settings and workflow are the issue?

Record at 960x540 16:9
Copy all media to desktop and use RAW2DNG to convert each shot (this step took ages since it also creates the ProRes files... but they're useful so I wouldn't want to do the process without them)
GingerHDR into AE to grade and make any other adjustments and make a rough cut, then InstantHD to 1080p
Import AE sequence into Premiere to make last minute changes and add some sound
Export at 1080p for Youtube

RESULT:

Raw files - raw2cdng - dng - Davinci Resolve 10 - proxies - edit - balance, color correct - relink - export.   
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 16, 2013, 07:47:19 AM
Good question.  I used a workflow and exported to both JPG and .TIFF.  HUGE DIFFERENCE.  You can see it in the overal picture quality, really shows up in lines.  But, it alos depends on what you are going for.  If you arent shooting art, or something that requires clean/soft presentation, you can get away with JPG even at 80% quality (20% compression).

As for the color...again, using TIFF just makes everything look better, especially in low light shots.

At this point, shooting RAW on 550D is easy.  The key is obviuosly a really fast SDHC or SDXC card, and a post production setup that allows a streamlined workflow.  The only real decision to make is the frame size (1280x544, 960x540, etc).  One doesn't need continuous FPS to get good shots.  24fps at 10 seconds is 240 frames recorded.  More than enough to do get good shots, and move from subject to subject, shot to shot, etc.

In terms of "post processing", speed can be obtained by switching to an SSD drive, getting more RAM, and having minimum 2 procs, preferably 4 proc setup.

Cheers.

Yoda



Hi Yoda,

Thanks so much for the suggestion :-)

Fortunately Blender supports .TIF files.

I'll then assume that .DNG and .TIF have more or less same amount of detail except .DNG will have a little more information because it's based on Adobe DNG structure whereas TIF is more commonly used in general where access to premium applications provided by Adobe and others are either very less or no access at all :-)

Thanks once again.

Cheers,
Prabhath MP 
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 16, 2013, 08:58:30 AM
I use Blender for grading and post-production of video and unfortunately Blender does not support .DNG file format :(
Why don't you work with DPX? Blender support it and I took a huge time with it.
The workflow is a little bit different:
1. Movie Clip Editor -> Open your sequence (DPX)
2. Video Sequence Editor -> Shift+A -> Clip -> Add you Clip

Cheers ^_^
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 16, 2013, 11:07:54 AM
Why don't you work with DPX? Blender support it and I took a huge time with it.
The workflow is a little bit different:
1. Movie Clip Editor -> Open your sequence (DPX)
2. Video Sequence Editor -> Shift+A -> Clip -> Add you Clip

Cheers ^_^

Hi Coolerinc :)

Thank you for the suggestion.

Could you please provide more information about your workflow for DPX files?

I only have option to convert RAW to either .DNG or .TIF

Which application would help in conversion of batch files from RAW to DPX?

Also, is that application available for Ubuntu 13.04?
 
Until now, I have been using .TIF format to import files into Blender for grading.
(Blender --> Video Editor --> Shift + A --> Image --> Identify the folder containing .TIF files --> A (to select all) --> Open)

Please let me know if I am missing any step :)

Thanks so much.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 16, 2013, 11:13:23 AM
At 0:15 the car is hiccupping ! What's the problem ? It's not my player...

Yes, the source files also seem to be displaying the same!  :o I think this is the effect rewind was talking about  below.

@dafassi, this stroboscopic effect you are talking about is inavoidable in 24fps shooting. It is always there in all the movies. But! You will almost never see the scene like yours in movies. It is always there is an Object in the scene which stays in frame and picks all your attention. All the pans DP doing are done with some purpose. There are no just pans in movies. It's always a following the object in foreground. And the foreground is the place, where the action happens.
Title: Re: 550D/T2i raw video recording port official thread
Post by: coolerinc on October 16, 2013, 11:38:25 AM
I only have option to convert RAW to either .DNG or .TIF

Which application would help in conversion of batch files from RAW to DPX?

Also, is that application available for Ubuntu 13.04?
 
Until now, I have been using .TIF format to import files into Blender for grading.
(Blender --> Video Editor --> Shift + A --> Image --> Identify the folder containing .TIF files --> A (to select all) --> Open)

Please let me know if I am missing any step :)

Hi prabhath.mp,
I'm using After Effects to convert any format into DPX
The benefits of using DPX or Tiff you can read here (http://www.reduser.net/forum/archive/index.php/t-25383.html), I am not a supporter of anything.
Your workflow is OK
Cannot say what converter is good for Linux. Perhaps using Tiff is the only way for this moment
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 16, 2013, 12:05:23 PM

Could you please provide more information about your workflow for DPX files?

I only have option to convert RAW to either .DNG or .TIF

Which application would help in conversion of batch files from RAW to DPX?

Also, is that application available for Ubuntu 13.04?


For windows I used Resolve for DNG to DPX exports. I haven't seen DPX workflows for Ubuntu/Linux options yet.
As @coolerinc says, would .TIFF from Blender be a viable alternative for you?


If you have the guts and patience, then using .TIFF is the only way to go.  The image quality is top notch.  Just takes a while to render during the import process (regarding your movie software).

Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 16, 2013, 12:23:14 PM
Hi prabhath.mp,
I'm using After Effects to convert any format into DPX
The benefits of using DPX or Tiff you can read here (http://www.reduser.net/forum/archive/index.php/t-25383.html), I am not a supporter of anything.
Your workflow is OK
Cannot say what converter is good for Linux. Perhaps using Tiff is the only way for this moment

For windows I used Resolve for DNG to DPX exports. I haven't seen DPX workflows for Ubuntu/Linux options yet.
As @coolerinc says, would .TIFF from Blender be a viable alternative for you?

Thank you both for your suggestion and inputs  :)

From this I have come to a conclusion that .TIF file is quite reasonable alternative for DPX (though there might be some drawbacks), however, it should be far more better than the native video (H.264), in terms of dynamic range and flexibility to process during post-production.

This has been very helpful.

Thanks so much once again.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 16, 2013, 03:33:49 PM
Has anyone been successful with Dual ISO on the 550d yet?
Title: Re: 550D/T2i raw video recording port official thread
Post by: Rewind on October 16, 2013, 06:23:16 PM
Has anyone been successful with Dual ISO on the 550d yet?

We are shooting dual ISO on 550D's for about a couple of months.
http://www.magiclantern.fm/forum/index.php?topic=5582.msg69853#msg69853
Title: Re: 550D/T2i raw video recording port official thread
Post by: studio on October 17, 2013, 10:24:47 PM
Didn't try to project on to the theater screen but I think the quality of RAW 1600x680 2.35:1 will be fine. BTW people in the theater don't sit too close to the screen :)

I think 1200 x 500 is pretty close to a Super 16mm blow up. The shots i am getting at that res would give you close to what you get with a blow up to 2084 x 854 which is flat cinema scope. Even shooting 2K you lose half the resolution vertically in 1:2.35
I love the look of this stuff. I feel more inspired by the ML raw hack on the 550D than i did about the HD h264 because the grade is everything and I like the grain structure that you get, it feels organic and you get to keep everything. Some shots do suck in cities, but that maybe because this hack desires you film in nature, away from symmetrical lines! I cant see much difference in handling between this and the EPIC (which is just as difficult to post) and insure!
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 18, 2013, 12:36:04 PM
I think 1200 x 500 is pretty close to a Super 16mm blow up. The shots i am getting at that res would give you close to what you get with a blow up to 2084 x 854 which is flat cinema scope. Even shooting 2K you lose half the resolution vertically in 1:2.35
I love the look of this stuff. I feel more inspired by the ML raw hack on the 550D than i did about the HD h264 because the grade is everything and I like the grain structure that you get, it feels organic and you get to keep everything. Some shots do suck in cities, but that maybe because this hack desires you film in nature, away from symmetrical lines! I cant see much difference in handling between this and the EPIC (which is just as difficult to post) and insure!

Wow, that was quite an inspiring statement actually :)

Thanks for your inputs. It has been very helpful.

I never knew that the quality of Epic in terms of dynamic range was more or less same as 550D (I have never got a chance to work with RED cameras until now :) )

Query to Magic Lantern Team:-
Team, you all are geniuses who have really made a revolution by creating such a wonderful firmware for Canon digital cameras (DSLRs particularly).

I will just pray to God that you get a Nobel award for all your efforts.

I was thinking, since we have so many people who use this firmware, I am sure I'm not the first person to be asking this query below:-

Why not design a camera? :)
Since, you all have so much knowledge in this field and you all know the limits of most Canon sensors, probably it would be easy for you to design an amazing camera with best features.

I sincerely respect your efforts so far. In a way I was motivated to take up photography/cinematography after I got to know about your application, while I was watching some video on Vimeo site few years ago :)

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: dlrpgmsvc on October 18, 2013, 01:56:48 PM
Why not design a camera? :)

Yet discussed, and decided it's a too costly operation with no advantages.
Sorry but they are so great geniuses (like you said) that they yet thinked, discussed and rejected the idea ! Sorry !  8)   
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 18, 2013, 04:19:20 PM
Yet discussed, and decided it's a too costly operation with no advantages.
Sorry but they are so great geniuses (like you said) that they yet thinked, discussed and rejected the idea ! Sorry !  8)   

:)

Opinions change over a period of time because they are always depending on situation. Hope the ML team will reconsider their decision once again and maybe in near future, there might be an actual 'Magic Lantern - 4K' camera :)

I'm just hoping/wishing that it'll be true someday in near future..

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: RenatoPhoto on October 18, 2013, 05:52:53 PM
Why not design a camera? :)
Since, you all have so much knowledge in this field and you all know the limits of most Canon sensors, probably it would be easy for you to design an amazing camera with best features.

Best if Canon make the cameras and hire the ML team as R&D.   ;)
Title: Re: 550D/T2i raw video recording port official thread
Post by: teo92 on October 18, 2013, 10:47:16 PM
Gold evening/morning guys, have a couple of question to ask you all.

I currently have a 550 and tried to shot some raw video. I read almost all the 44 pages but still have some questions: i recorded at 960 at 23,976 and managet to get 576 frames (i think continuos recording). I used the tool to export dng files and opened them as a sequence in after effects, did some games in camera raw and opened the composition. Now problem comes: the quality during te scaling up to 1920 become horrible. I an clearly see pixels. How can this be possible?

Please, be patient with me, it's the first time for me here.

Thanks in advance, Matteo
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 20, 2013, 05:07:58 PM
You can't upscale a 960x540 file to 1080p and expect great quality.  If that were the case...we wouldn't need better equipment for 2K, 4K, etc.  In addition, how you manage the files in post processing, any compression applied, will greatly affect the outcome.

I read your example and tried an experiment.  I recorded a 960x540 RAW, tranformed to DNG files, imported in Lightroom, applied color grading, and exported to 1920x1080p. Then used Quicktime Pro 7 to create the movie file.  Went terrible.  Pixels, looked like a bad VCR recording (if you are old enough to know what that is).

Suggestion:  If you wan a "full screen look", you might try using one of the anamorphic aspect ratios (2.35:1, 2.67:1, etc).  I used a 1280x320, and got continuos recording at 24fps.  There is a trade off.  The wider you go with your aspect ration, the shorter the height will be on your video.  Wide look works for me, because when you export at the same aspect ratio your file was captured in, it will automatically look anamorphic when imported into your movie software (Premiere, FCPX, Avid, etc).

Bottom line:  The 550d raw capabilities at this stage of the game are VERY limited.  If you want more picture "real estate" (aka screen size), get a better camera.  The 50D has a much better hardware, and you can get them used on Craigslist for about the same price as one of the Rebel cameras.

Cheers,

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 20, 2013, 05:19:10 PM
I should say one more thing. and this is just "my $.02".

Because of the hardware limitations of the 550D, I do not believe you can upscale any video to 1080p with any decent quality.  HOWEVER, you CAN use a 1280x720p project, and get great quality.

Example workflow:

* Capture in 1280x320 at 24fps (use FPS over ride on ML)
*  Convert RAW file to DNG files
*  Import into Lightroom (or After Effects)
*  Apply color grading and other desire effects
*  Export as TIFF files, no compression, best quality, using original dimensions (1280x320)
*  Import image sequence into Quicktime Pro ($30).  Export to .MOLV (Apple ProRes 422 codec), use original source for frame size, frame rate, etc.
*  Open any NLE (FCPX, Premiere, etc).  start new project.  Use 1280x720 as your dimensions, 24fps.
*  Import your .MOV File.  Apply to video track (or in FCPX, the timeline).  Video should look anamorphic at this time in the preview pane.
*  Export (or share) movie using same Apple 422 codec.  Do not change any quality settings.
*  If desired for Youtube sharing, you can use any conversion utility such as Quicktime Pro, Compressor or other software to convert it to the h.264 desired format for streaming.
*  Done.

Note:  You CAN export to h.264 directly from your NLE, but the conversion process usually takes longer vs using a dedicated utility.

Hope this helps.  Works for me, and unless you have a trained eye (or are horrible in your capture/post processing technique), no one will know you even used a 550D when they see "the results".

If it looks good for you, thats all that matters in the end.

Cheers,

Yoda
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on October 20, 2013, 09:09:06 PM
Here is a video I did this morning that shows "the results" using the method I just described.  Even though it is only 720p, at full screen it looks way better than a scaled 960x540 vid on 1080p.

http://www.youtube.com/watch?v=S1j3g9KjibA
Title: Re: 550D/T2i raw video recording port official thread
Post by: mine85 on October 21, 2013, 09:54:20 AM
Is this Prores workflow applicable in Windows too? Sorry for the nOOb question.


*  Export as TIFF files, no compression, best quality, using original dimensions (1280x320)
*  Import image sequence into Quicktime Pro ($30).  Export to .MOLV (Apple ProRes 422 codec), use original source for frame size, frame rate, etc.


Thanks!  :D
Title: Re: 550D/T2i raw video recording port official thread
Post by: prabhath.mp on October 21, 2013, 07:14:54 PM
Because of the hardware limitations of the 550D, I do not believe you can upscale any video to 1080p with any decent quality.  HOWEVER, you CAN use a 1280x720p project, and get great quality.

Example workflow:

* Capture in 1280x320 at 24fps (use FPS over ride on ML)
*  Convert RAW file to DNG files
*  Import into Lightroom (or After Effects)
*  Apply color grading and other desire effects
*  Export as TIFF files, no compression, best quality, using original dimensions (1280x320)
*  Import image sequence into Quicktime Pro ($30).  Export to .MOLV (Apple ProRes 422 codec), use original source for frame size, frame rate, etc.
*  Open any NLE (FCPX, Premiere, etc).  start new project.  Use 1280x720 as your dimensions, 24fps.
*  Import your .MOV File.  Apply to video track (or in FCPX, the timeline).  Video should look anamorphic at this time in the preview pane.
*  Export (or share) movie using same Apple 422 codec.  Do not change any quality settings.
*  If desired for Youtube sharing, you can use any conversion utility such as Quicktime Pro, Compressor or other software to convert it to the h.264 desired format for streaming.
*  Done.

Note:  You CAN export to h.264 directly from your NLE, but the conversion process usually takes longer vs using a dedicated utility.

Hope this helps.  Works for me, and unless you have a trained eye (or are horrible in your capture/post processing technique), no one will know you even used a 550D when they see "the results".

If it looks good for you, thats all that matters in the end.


Hi Yoda,

Thanks so much for the inputs.

Will there be any difference in quality if we were to use only one application to render the video? I use Blender, by importing .TIF files as a sequence and then it is rendered in .H264 (.AVI) format.

Also, could you advise which video format would contain more details? (Preferably supported by Blender) :)

Thanks so much.

Cheers,
Prabhath MP
Title: Re: 550D/T2i raw video recording port official thread
Post by: Yoda on