12-bit (and 10-bit) RAW video development discussion

[Levas]

 
I tried the latest resolution values with this dma flag in edmac-memcpy.c

uint32_t dmaFlags = 0x60000000

And looks like we have working live view and NORMAL FRAMES on 6d 


I'll test some more, to be really sure it works 

[Levas]

Yep, 10 bit recording works flawlessly on the 6d, with live view

Although with 12 bit recording something weird is still going on (as mentioned before in this topic).
with 12 bit recording MLV_dump finds a lot of cold pixels and the image has specles all over it.

[nikfreak]

congrats Levas. Was worth all your efforts and guess it feels great making yourself a xmas gift. Submitting a PR @bitbucket will make it perfect 

[Danne]

Wow. Beautiful work on the 6D everyone and Levas .

Maybe needless to say but are you disabling cold pixel and vertical stripes settings in mlv_dump?
http://www.magiclantern.fm/forum/index.php?topic=5601.msg176263#msg176263

[Levas]

@Alex
uint32_t dmaFlags = 0x40000000
Works too, so before it didn't probably work because of the wrong resolution settings.

@Nikfreak
Submitting @bitbucket, what do you think I am, a developer 
And my coding skills aren't that good,in order to use the right dmaFlags my version, for sure, won't work for some other cams that worked before

@Danne
You're right, disabling stripe fix and cold pixel fix gives good frames.
But I always thought the stripe fix was nessecarry  ?

[eNnvi]

Could you also try with edmac flags of 700D?

[Levas]

@eNnvi
I've tried the following dma flag as used for 700d
uint32_t dmaFlags = 0x20000000

And it causes the 'RAW DETECT ERROR' and when it will record it gives the scrambled frames.

So the only settings that were wrong in your build are the height value settings for the different video modes (width values were all good)
#ifdef CONFIG_6D
    *width  = zoom ? 2768 : mv720 ? 1920 : 1920;
    *height = zoom ? 988 : mv720 ?  662 : 1252;    /* find correct mv720 height -- must be exact! */   
    return 1;
#endif

And the dma flag setting, which must be either
uint32_t dmaFlags = 0x40000000 or uint32_t dmaFlags = 0x60000000

[nikfreak]

So, confirmed!

[Levas]

Yes confirmed, both values work

[Levas]

Is somebody willing to do a pull request for this for the 6d?

I can send the pieces of code that needs to be altered/added in a pm.

[dfort]

Is somebody willing to do a pull request for this for the 6d?

Sure, no problem. Let's get some developers reviewing the changes you and eNnvi made and post a test build for other 6D users.

@nikfreak -- do you have a branch in your repo that I can use to make test builds for the 70D and 100D?

Off topic -- Just a suggestion. It would be great to get those platforms merged and perhaps prune the branch for the 1100D if that platform is no longer supported.

[EDIT]
Back on topic -- so if CONFIG_EDMAC_RAW_SLURP was working on the 1100D at one time why was it removed? Seems like that camera could really use the 10bit/12bit treatment though at this point it doesn't work at all with raw video.

[nikfreak]

just updated the 100D PR.
70D PR should already contain all relevant info needed as far as I remember.

Wishing ya fun.

[RenatoPhoto]

You guys are amazing with the improvements upon the great foundations of Magic Lantern.
Thanks to all and congratulations on this new breakthrough!

I use the 1.23 firmware so finally I had a little time to test it with magiclantern-raw_video_10bit_12bit.2016Dec20.5D3123.zip (great work dfort)
WOW! WOW! WOW!
I tested the mlv_rec and raw_rec with the raw_twk.  Great accomplishments here dfort, g3gg0, and all contributors!

Video quality:  I cannot see any difference at iso 6400 or at iso 100.  All of them look superb on 10/12/14 bits.
Video size: Amazing 40% lighter dng frames going from 14 bits to 10 bits.  Pixel peeping the dngs at 300% show no difference between 10/12/14 bit!
Color and Exposure are identical.  Bumping exposure by 3ev on Photoshop does not bring up any differences on shadows.

Standard Max Recording Resolutions 5D3 with 64 GB Lexar 1066:
Origninal mlv_rec + spanning + Auto preview + sound at 1920x1080 30fps same with crop module: 17 sec max recording
Original mlv_rec + Auto preview + sound at 1920x1080 30fps with crop module: 17 sec max recording
Original raw_rec + Auto preview at 1920x1080 30fps same with crop module: 23 sec max recording

10/12/14 BIT TESTING
With magiclantern-raw_video_10bit_12bit.2016Dec20.5D3123
Note: I cannot find the card spaning on new mlv_rec

14 bit
mlv_rec + canon preview + sound at 1920x1080 30fps same with crop module: 16 seconds recording time
raw_rec + canon preview 23 sec at 1920x1080 30fps: 23 seconds recording time
raw_rec + canon preview 32 sec at 1920x1080 30fps at 5x croped: 35 seconds recording time!! dont know why the croped records faster.

12 bit
mlv_rec + Auto preview + sound at 1920x1080 30fps: continuous recording
mlv_rec + Auto preview + sound at 1920x1080 30fps at 5X cropped: continuous recording
Max continuous recording mlv_rec + Auto preview + sound at 1952x1098 or smaller at 30fps

raw_rec + canon preview 23 sec at 1920x1080 30fps: continuous recording
raw_rec + canon preview 32 sec at 1920x1080 30fps at 5x croped: continuous recording
Max continuous recording raw_rec Continuous recording with 2000x1126 30fps or smaller resolutions.

note: mlv_play crashes (play quits and camera has some error since the red led keeps blinking) on crop video larger than 1968x1108

10bit
Max continuous recording mlv_rec + Auto preview + sound at 2144x1206 or smaller resolutions at 30fps.
Max continuous recording raw_rec Continuous recording with 2208x1242 or smaller resolutions at 30fps.

Although I do not contribute to the forum due to time constrains I do come here all the time and look for all the updates on 5D3 1.23.  I use my 5D3 often and take lots of bird photos and RAW video.
I truly enjoy all of the amazing things you guys accomplish.  It is stunning!
THANK YOU!  THANK YOU!  THANK YOU!
Merry Christmas and happy new year to all!

[eNnvi]

pull request for 6D done.

now i'll try to work in 7D (i like the hard things ). As i don't own one i have to ask if anybody want to help me (possibly having that camera )

[dfort]

Looks like @a1ex already merged the 6D pull request, that was fast.

There's also another change I didn't see coming. The 700D now has "#define PREFERRED_RAW_TYPE 0x10" while the 650D still has "#define PREFERRED_RAW_TYPE 78" commented out. They both used to be commented out. What's the reason for that?

[a1ex]

Back on topic -- so if CONFIG_EDMAC_RAW_SLURP was working on the 1100D at one time why was it removed?

It wasn't removed. There are some missing bits from the raw branch (such as skip offsets), so the branch wasn't merged. Start reading from here; some of those bits are already there and just need to be put together in a commit.

[dfort]

Thanks for the tips. Danne has access to an 1100D so we might team up and work on it, though it isn't a high priority for either of us.

Just noticed the 1100D build was broken for about one week, and nobody reported the error.
Is there anybody still using this camera, or should I discontinue this port?

So it wasn't intentional?@dmilligan also has one but it looks like he isn't using it much these days - and there's a math problem:

The 1100D nightly build was intentionally disabled because a1ex noticed some incorrect values for FPS override timers. I've never cared enough to try and fix it (the Maths involved hurt my head ), I just compile it with the old incorrect values.

Getting the 1100D working isn't my goal, I'm just trying to get a better understanding of ML and looking at CONFIG_EDMAC_RAW_SLURP on that camera opened this can of worms. In any case, years ago I did some beta testing and the company sent me their lowest end system. Why not their most powerful? Because they wanted to make sure their minimal configuration was still valid or if they should discontinue support for it.

[dfort]

6D added to the test builds:

https://bitbucket.org/daniel_fort/magic-lantern/downloads

Make sure to load the raw_twk module if you want in camera playback of 10/12 bit files.

[dfort]

just updated the 100D PR.
70D PR should already contain all relevant info needed as far as I remember.

Thanks. 100D was pretty much ready. Merged the 70D_merge_fw112 branch with raw_video_10bit_12bit.

Test builds for 100D and 70D posted.

https://bitbucket.org/daniel_fort/magic-lantern/downloads

[dmilligan]

So it wasn't intentional?

1100D has been broken multiple times in the past, sometimes on purpose, sometimes on accident. It is currently broken on purpose. The 1100D was probably the easiest platform to break on accident because of its unusual combination of CONFIG options enabled (so not being careful about #ifdefs would be more likely to result in code that won't compile without being noticed, for example 1100D could do QR raw but not LV raw, but there's a lot of shared code between the two).

[andy kh]

[quote Merged the 70D_merge_fw112 branch with raw_video_10bit_12bit.

Test builds for 100D and 70D posted.

https://bitbucket.org/daniel_fort/magic-lantern/downloads
[/quote]

i wil be able to test 70D tonight after reaching home. Thank q dfort. I have been waiting for so long

[ShootMeAlready]

70D tried a quick test.

1832@ 2.35 apsect, 24fps 10bit, could record for over 1 minute (probably continuous), the movie review but it never builds the movie because it hangs/bricks requiring battery pull and two resets to get right.
1832@ 2.35 aspect, 30fps 10bit, could record for 18s, but same hang/brick.
1832@ 2.35 aspect, 24fps 12bit, could record for 28s, but same hang/brick. 
1846@ 2.35 aspect, 60fps 12bit, 3X mode on, could record for 9s, but same hang/brick.
1920@ 2.35 aspect, 24 fps 10bit, 5X zoom, could record for over 1 minute (probably continuous), two second in got a "hack error" but it kept on recording until I hit stop rec.,  but same hang/brick occurs. Not sure with hack error to trust the record time.
2220 @2.35 aspect, 24 fps 10bit, 5Xzoom,  hack error at 0 sec kept recording over 1 minute, but when I switched to photo mode it showed 51 sec record, so I cant trust either number.

It did produce MLV files, but Mystic could not convert any MLV to DNG.  This same program worked with my 600D 10/12 bit MLV files.
Will try mlv_dump on the files once I have more time. 

[Oswald]

Live view still freezes with 100d. I just tested it. I downloaded the @dfort build. 

[nikfreak]

dfort probably didn't enable edmac_raw_slurp before compiling for 100d. Just a guess as I didn't try myself.

[dariSSight]

@dfort and @reddeercity for your help to make 5D Mark II even better, which build is the best so far Dec1, Dec12, or Dec18  I never got Dec9? I had some corruption with Dec18 but I'm going to do some more test, also will there be a update build from @dfort for 5DMarkIi soon?