Magic Lantern Forum

Developing Magic Lantern => Reverse Engineering => Topic started by: reddeercity on September 07, 2016, 05:40:54 AM

Title: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: reddeercity on September 07, 2016, 05:40:54 AM
Hi , Just like it says I did a Picture Style HDMI Capture & internal ML H264 Recording  of LogNetural plus TechCineStyle , C-LOG-htp , Canon Netural , Canon Standard , Canon Landscape & Canon Monochrome (Just for the hell of it :) .  I used a static Image with all setting the same on My 5D2  ,  I Also would to make note of the Color Space on the 5D2 , not all EOS camera internal recording is in Rec709 , the 5d2 and I not to sure about others record to SD color space in Full range and that's why for at least the 5d2 the Techincolor CineStyle works so will. Now 5D3 and other record in Rec709, so the LogNetural would be better suited Picture Style . That being said I found very little difference on my 5D2 between Techincolor CineStyle & LogNetural  . I notice a little more lift in the mids with Tech.CineStyle then LogNetural . To make this a good compare test I add 6 other picture Styles , Why you my ask ? will this is really to see how good the HDMI Stream is as it's effected by Picture Style from liveview . This would I did , Captured the HDMI Stream in 2 different formats & codecs. I captured to DPX 10BE RGB , Apple 10bit ProRes 422HQ(260Mb/s) & Apple 8bit YCbCr Uncompressed (1000 Mb/s) Once in FCPX I Screen Capture every Picture Style from h264 , prores , YCbCr & exported single frames from each file .
I'll post links to my dropbox to all the Screen Captures & exported Frames as png's also i'll have a link for the Single Frame DPX file too.
Dropbox DPX Frames (https://www.dropbox.com/sh/p029yya0fgn13o6/AAAskmoMsRTOXcUiDAwPs2UDa?dl=0) , Dropbox Screen shots FCPX_Pic Style Test_H264 (https://www.dropbox.com/sh/wy1k365xo1df7xa/AABpo2l-3y2mDVg8oIgIiefoa?dl=0) , Dropbox Screen Shots FCPX Pic Style Test_ProRes422HQ (https://www.dropbox.com/sh/zn8r6e4nqvqcw81/AAAlcOcEHqi7q3Y1r-OMmepla?dl=0) ,Dropbox Screen Shots FCPX_Pic Style Test_8bit_YCbCr (https://www.dropbox.com/sh/burq19gqd8lfvhe/AAC5vbWtpdFnS-rsObR0-ibya?dl=0) Here a small Camera mov 29MB with the log metadata file LogNetural_H264 (https://www.dropbox.com/sh/03sq2a2gu2incc1/AAACLun9IRO7ln4RgXmFcXhRa?dl=0) and also a small 60 MB ProRes 422HQ File LogNetural Apple ProRes422HQ (https://www.dropbox.com/sh/cajl8hwphnqzmbg/AADjMXJoCoWL3whywRK4-6p5a?dl=0)
Below Camera Setting As per the Log file.
------------------------------------------------------ 
# Magic Lantern v2.3.NEXT.2014Feb16.5D2212
Lens name      : EF100mm f/2.8L Macro IS USM
ISO            : 320
Shutter        : 1/38.872s
Aperture       : f/7.0
Focal length   : 100 mm
Focus distance : 1090 mm
White Balance  : 4800K, Magenta 0, Blue 0
Picture Style  : logNeutral (0,-4,-2,0)
FPS            : 23.976
Bit Rate (CBR) : 2.3x
-----------------------------------------------------

Screen Shots FCPX H264 Time Line with Scopes
(https://c4.staticflickr.com/9/8064/29429294371_3c865d8f0f_c.jpg) (https://flic.kr/p/LQyPV6)
Screen Shot_FCPX_H264_LogNeutral_2016-09-05 at 7.21.31 PM (https://flic.kr/p/LQyPV6) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c8.staticflickr.com/9/8493/29509492415_858ec1264a_c.jpg) (https://flic.kr/p/LXDRZZ)
Screen Shot_FCPX_H264_Tech_CineStyle_2016-09-05 at 7.23.34 PM (https://flic.kr/p/LXDRZZ) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c8.staticflickr.com/9/8542/29509498575_89cd918486_c.jpg) (https://flic.kr/p/LXDTQc)
Screen Shot_FCPX_H264_C-LOG-HTP_2016-09-05 at 7.25.51 PM (https://flic.kr/p/LXDTQc) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c8.staticflickr.com/9/8647/29429292271_8816c81aaa_c.jpg) (https://flic.kr/p/LQyPhT)
Screen Shot_FCPX_H264_Neutral_2016-09-05 at 7.18.42 PM (https://flic.kr/p/LQyPhT) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c7.staticflickr.com/9/8421/29400964262_83af552241_c.jpg) (https://flic.kr/p/LN4CmW)
Screen Shot_FCPX_H264_Standard_2016-09-05 at 7.04.23 PM (https://flic.kr/p/LN4CmW) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

--------------------------------------------------------------------------------------------------------------------------------------------------

Apple ProRes 422HQ 60i

(https://c6.staticflickr.com/8/7696/29509548445_b710373a88_c.jpg) (https://flic.kr/p/LXE9E2)
Screen Shot_FCPX_HDMI_ProRes_LogNetural_2016-09-05 at 7.49.40 PM (https://flic.kr/p/LXE9E2) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c8.staticflickr.com/9/8886/29429329711_bbb370d90b_c.jpg) (https://flic.kr/p/LQz1qp)
Screen Shot_FCPX_HDMI_ProRes_LogNetural_Scaled118%_2016-09-05 at 10.54.20 PM (https://flic.kr/p/LQz1qp) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c6.staticflickr.com/9/8216/29429327101_fb7ab899c6_c.jpg) (https://flic.kr/p/LQyZDp)
Screen Shot_HDMI_FCPX_ProRes_Technicolor_CineStyle_Unscaled2016-09-05 at 7.52.40 PM (https://flic.kr/p/LQyZDp) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c5.staticflickr.com/9/8126/29400998532_a4eb4cbe83_c.jpg) (https://flic.kr/p/LN4NxN)
Screen Shot_FCPX_HDMI_ProRes_Technicolor_CineStyle_Scaled118%_2016-09-05 at 10.46.03 PM (https://flic.kr/p/LN4NxN) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c2.staticflickr.com/9/8323/29509550065_d7a6c37b84_c.jpg) (https://flic.kr/p/LXEa8X)
Screen Shot_FCPX_HDMI_ProRes_C-Log-HTP_2016-09-05 at 7.55.43 PM (https://flic.kr/p/LXEa8X) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c3.staticflickr.com/9/8111/29475324666_353a44e6e8_c.jpg) (https://flic.kr/p/LUCK7S)
Screen Shot_FCPX_HDMI_ProRes_C-log-HTP_Scaled118%2016-09-05 at 7.56.52 PM (https://flic.kr/p/LUCK7S) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c1.staticflickr.com/9/8180/29401000712_3a11f5019e_c.jpg) (https://flic.kr/p/LN4Pco)
Screen Shot_FCPX_HDMI_ProRes_Netural_Scaled118% 2016-09-05 at 7.47.21 PM (https://flic.kr/p/LN4Pco) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

------------------------------------------------------------------------------------------------------------------------------------------------------------------

Apple 8bit YCbCr Uncompressed

(https://c2.staticflickr.com/9/8224/29429464121_f45d677aa5_c.jpg) (https://flic.kr/p/LQzGnP)
Screen Shot_FCPX_HDMI_YCbCr_LogNetural_Scaled118% 2016-09-05 at 8.31.37 PM (https://flic.kr/p/LQzGnP) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c4.staticflickr.com/9/8261/29509683795_8dee592e14_c.jpg) (https://flic.kr/p/LXEQTD)
Screen Shot_FCPX_HDMI_YCbCr_Technicolor_CineStyle_Scaled_118%_2016-09-05 at 8.24.24 PM (https://flic.kr/p/LXEQTD) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c1.staticflickr.com/9/8304/29401167352_8f32da94f1_c.jpg) (https://flic.kr/p/LN5EJu)
Screen Shot_FCPX_HDMI_YCbCr_C-Log-htp_Scaled118%_2016-09-05 at 8.34.43 PM (https://flic.kr/p/LN5EJu) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c5.staticflickr.com/9/8604/29401131772_7821c7b10d_c.jpg) (https://flic.kr/p/LN5ua3)
Screen Shot_FCPX_HDMI_YCbCr_Netural_Scaled118% 2016-09-05 at 8.28.57 PM (https://flic.kr/p/LN5ua3) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr


-----------------------------------------------------------------------------------------------------------------------------------------------------

Frame Export from FCPX Time Line ProRes Files

(https://c5.staticflickr.com/9/8652/29475572756_647c8262e8_z.jpg) (https://flic.kr/p/LUE1Sh)
HDMI_ProRes422HQ_LogNetural_Scaled118 (https://flic.kr/p/LUE1Sh) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c3.staticflickr.com/9/8102/28884846434_8792635b31_z.jpg) (https://flic.kr/p/L1sovG)
HDMI_ProRes422HQ_TechincolorCineStyle_Scaled118 (https://flic.kr/p/L1sovG) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c7.staticflickr.com/9/8423/29475600086_0e4bfe3aa5_z.jpg) (https://flic.kr/p/LUE9Zu)
HDMI_ProRes422HQ_C-Log-htp_Scaled118 (https://flic.kr/p/LUE9Zu) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c5.staticflickr.com/9/8032/28884864364_38ff497900_z.jpg) (https://flic.kr/p/L1stQQ)
HDMI_ProRes422HQ_Netural_Scaled118 (https://flic.kr/p/L1stQQ) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

---------------------------------------------------------------------------------------------------------------------------------------------------------------

Frame Export FCPX Time Line 8bit YCbCr Files

(https://c5.staticflickr.com/9/8012/29475636476_a9fe6fda79_z.jpg) (https://flic.kr/p/LUEkNU)
HDMI_8b_YCbCr_LogNetural_Scaled118 (https://flic.kr/p/LUEkNU) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c2.staticflickr.com/9/8850/29429607081_a29af1772a_z.jpg) (https://flic.kr/p/LQAqSD)
HDMI_8b_YCbCr_TechincolorCineStyle_Scaled118 (https://flic.kr/p/LQAqSD) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c3.staticflickr.com/9/8528/29401290922_fb35088d69_z.jpg) (https://flic.kr/p/LN6it1)
HDMI_8b_YCbCr_Netural_Scaled118 (https://flic.kr/p/LN6it1) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c5.staticflickr.com/9/8295/29475633876_34eece9705_z.jpg) (https://flic.kr/p/LUEk35)
HDMI_8b_YCbCr_Monochrome_Scaled118 (https://flic.kr/p/LUEk35) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

--------------------------------------------------------------------------------------------------------------------------------------------------------------------

Frame Export FCPX Time Line H264 Files

(https://c5.staticflickr.com/9/8252/29475672316_1fbf903efe_z.jpg) (https://flic.kr/p/LUEwsQ)
H264_LogNetural(0,-4,-2,0) (https://flic.kr/p/LUEwsQ) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c7.staticflickr.com/9/8302/29475666126_855fff8cc5_z.jpg) (https://flic.kr/p/LUEuC7)
H264_TechincolorCineStyle(0,-4,-2,0) (https://flic.kr/p/LUEuC7) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c2.staticflickr.com/9/8178/29509917505_756a0e3017_z.jpg) (https://flic.kr/p/LXG3n8)
H264_C-Log-htp(1,-4,-1,0) (https://flic.kr/p/LXG3n8) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c2.staticflickr.com/9/8475/29429666841_d6bcdcd1a1_z.jpg) (https://flic.kr/p/LQAJCZ)
H264_Netural(1,-1,-2,0) (https://flic.kr/p/LQAJCZ) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c8.staticflickr.com/9/8232/29509898335_b7dfb4b9ef_z.jpg) (https://flic.kr/p/LXFWEB)
H264_Standard(3,0,0,0) (https://flic.kr/p/LXFWEB) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c2.staticflickr.com/9/8537/29429679761_71587b2241_z.jpg) (https://flic.kr/p/LQANtK)
H264_Landscape(4,0,0,0) (https://flic.kr/p/LQANtK) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

(https://c5.staticflickr.com/9/8334/29401330892_ee2124a5ae_z.jpg) (https://flic.kr/p/LN6vm9)
H264_Monochrome(3,0,0,0) (https://flic.kr/p/LN6vm9) by RedDeerCityTV (https://www.flickr.com/photos/67942440@N06/), on Flickr

Well that's not all of the screen shots , but you can link out to my Flickr page to see all shots , plus I have Dropbox links to All of the PNG's
and don't forget I also have Dropbox Video links to  a 60MB 1080 60i prores & 28MB 24p H264 file.

Thanks for your time , I'll be back with more comments & suggestions .  :)



















Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: dfort on September 07, 2016, 04:25:39 PM
Whoa--this is like the mother of all tests.

I'm about to get on a plane for a month long trip so I won't be able to digest all of this but it is quite an exhaustive test. I'm thinking that for HDMI external recording you might look into the EOSHD C-Log (http://www.eoshd.com/2016/09/now-available-eoshd-picture-profiles-brings-c-log-canon-dslrs-including-1d-x-mark-ii-5d-mark-iv/) picture style. It is more "aggressive" than CineStyle but it should hold up fine in 4:2:2 Prores. I haven't done much testing with it.
Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: Brawl on September 08, 2016, 07:29:25 PM
what about this one? (this is free)
http://www.eoshd.com/comments/topic/20570-all-canon-cameras-gets-custom-c-log-profile/?do=findComment&comment=159552
Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: reddeercity on September 10, 2016, 06:51:57 AM
Going thought some old files and came across some old Picture Style Profiles for film flat look
link to my dropbox Genesis_Panalog4_WIP (https://www.dropbox.com/s/n8w8qmsdor2mt51/Genesis_Panalog4_WIP.pf2?dl=0) I haven't tried it in many years.
If I remember right it was before techincolor cinestyle , but not as flat , more forgiving in the mids & nice cine-skin tones .
Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: dfort on September 10, 2016, 01:43:48 PM
Interesting curves on that Genesis_Panaglog4

(https://c4.staticflickr.com/9/8011/29581582395_fde1b685b8_z.jpg)
Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: reddeercity on September 11, 2016, 01:56:54 AM
Found this on Vimeo


http://vimeo.com/27547717
QuoteCanon Standard vs Superflat vs Marvels Cine vs Genesis Panalog Picture Styles from Hatch Studios (https://vimeo.com/hatchstudios)
A visual comparison done for myself of the most commonly-used picture styles for cinematic video.
Canon Standard vs Superflat vs Marvels Cine vs Genesis Panalog.
These picture styles (with the exception of Canon Standard) provide a much higher dynamic range in your footage for greater creative freedom in post.

Camera: Canon 5D Mark II
Lens: Canon EF 50mm 1.4
Post: After Effects

I like the Genesis Panalog PS in this test I think it gives a good balance , on HDMI I'm betting it will give good range with out to much problem.
Title: Re: Reverse Engineered LogNetural/Tech.CineStyle Pic.Style HDMI ProRes+H264 test
Post by: dfort on September 11, 2016, 07:02:59 AM
You shouldn't be judging a log picture style by its look. One of the reasons for shooting with a log gamma picture style is get as much of the sensor's dynamic range as possible. The result will be a dark, flat, ugly picture on the screen. You should use a monitor that accepts viewing luts to work with log picture styles. The Atmos Ninja Blade (https://www.atomos.com/ninja-blade/) can accept various log inputs and display a normal looking image while recording the log signal.

There has been some debate whether it is possible to create a proper log gamma custom picture style using the Canon Picture Style Editor. In professional cinema cameras it seems that log can capture pretty much the same amount of dynamic range as shooting raw. The main difference when shooting log is that you've got to be careful to get the right color balance, in raw you can adjust in post. Speaking of post the big advantage of shooting log over raw is easier data wrangling.

In the current state of affairs with our Canon DSLR's log will never surpass shooting raw because the camera can only output 8-bit 4:2:2 through HDMI and record 8-bit 4:2:0 compressed H.264 internally. However, for many situations that is acceptable.

[EDIT] Take what I say with a grain of salt. Much of what I'm reporting here comes from conversations with friends who have much more experience with this stuff (S-Log, Log-C, etc.) than I do.