Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Messages - Milk and Coffee

Pages: [1] 2 3 ... 5
Raw Video / Re: History of ML cracking RAW
« on: October 27, 2021, 05:51:08 AM »
I know that there were two formats of Magic Lantern RAW video files. The current, .MLV. Are both formats just as RAW as the other? Any benefits or caveats to either format?

Also, is the data stored RAW Sensor Data (not debayered)? Or is it a “flavor” of RAW similar to Blackmagic’s .BRAW (already debayered)?

Does MLV store RAW data in a linear gamma?

I’m reading that cameras that store RAW sensor data linearly, the dynamic range is limited to the bit depth. Whereas cameras that store RAW sensor data logarithmically, the dynamic range is not limited by the bit depth.

Example: In cameras that store sensor data linearly, capturing a 10bit signal, limits the available dynamic range to be captured to 10 stops.

General Help Q&A / Re: App for viewing Code
« on: March 09, 2021, 04:31:31 PM »
Thank you all for the responses! I’m slowly catching up! Appreciate your patience 🙏

General Help Q&A / Re: App for viewing Code
« on: March 09, 2021, 03:37:25 AM »
I can tell you that I don't think there is Bayer *data* in the files, simply because there isn't a need.

Thank you! Could you be more specific about what you mean by “Bayer Data”? I thought bayer data was present in all RAW sensor data? If there is no Bayer Data, does that mean it’s not RAW?

And thanks Walter! I’ll give that one a go!

General Help Q&A / Re: App for viewing Code
« on: March 08, 2021, 04:33:51 PM »
I want to open my own CR2 images and compare the data to that of the same CR2 converted to DNG. I also would like to compare the Bayer data of a CR2 and a frame from an MLV. And if I'm feeling crazy, I'd also like to look at Canon's SRAW since it looks like it doesn't contain any Bayer data.

Thank you for your patience! - So to see the text format example, the file needs to be parsed. To parse the file, I should use DCraw (I see that's what the original article is using.)?

General Help Q&A / Re: App for viewing Code
« on: March 08, 2021, 03:40:02 AM »
So I downloaded "Hex Fiend" for mac. From this link I'm seeing code examples like this:

Code: [Select]
(5D Mark II RAW) 
JPEG_SOF3: length=20
 bits=14, wide=1448, high=3804, nb comp=4
  index=1, h=1, v=1, qt=0
  index=2, h=1, v=1, qt=0
  index=3, h=1, v=1, qt=0
  index=4, h=1, v=1, qt=0

I'm not seeing any code like that in the Hex Editor. I see the Hexidecimals of course, but the plain text view is nothing like the above. I tried as well. Is there a "view" setting I need to change? Is a Hex editor the correct program to view code in the format above / is there another app out there that shows me code similar to the above?

Let me know if you need clarification

General Help Q&A / Re: App for viewing Code
« on: March 03, 2021, 01:55:10 AM »
You want a hex editor, there are many options.  010 Editor is very good, and has a free trial.

This is SO helpful! Thank you!

General Help Q&A / App for viewing Code
« on: March 02, 2021, 04:06:25 AM »
This is a total newb question, but I just need some help to get started on the right foot:

What app can I use to view the “code” that makes up a .CR2 or .DNG file?

That is a link that provides an explanation of the code inside a .CR2 file. BUT I cannot figure out how to open my own .CR2 files to view the “code.”

What apps allow me to do this on macOSX?

Thanks so much!

Nevermind, I see we can debayer straight to linear with CDNG in Davinci Resolve 👌

Thanks kharak! I prefer to use unmanaged YRGB. I’m not by my computer, but I believe YRGB requires debayer to either be 709, P3, or BMD Film. If I debayer with BMD film, then CST to linear, is that any different than starting with linear as an input with YRGB Color managed?

What is the benefit of first converting to linear? In Davinci, is that using the OFX Color Space Transform to linear, then again from linear to 709?

Raw Video / Re: Raw video on 5DMK2
« on: February 23, 2021, 05:05:16 AM »
Thanks everyone.

I actually went back to the last nightly build from 2018, for stability issues, one of the experimental builds I was using seems to corrupt files every now and then. I am only interested in using 14bit raw anyway.

I am having issues with my external monitor, sometimes I get pink flickers for a second and my last batch if clips had flickering issues that ruined them.

Is there a problem with the 5d2 and using an external monitor in raw?
(Both the experimental build and the older nightly build, seemed to cause some issues when I plugged my Cinieroid HDMI EVF/monitor).


I have the same issue recording in both 10 and 12 bit using an external monitor.

Raw Video / Re: History of ML cracking RAW
« on: January 24, 2021, 05:45:33 PM »
Walter, that is great news! I also think it might be time for some cleaning up!

1. was access to the DMA (EDMAC) what enabled us to capture RAW video? Are there any caveats to the RAW files (its truly RAW???)
2. normal h.264 video had to go from the DMA to the CPU, then into the card correct?

Raw Video / Re: History of ML cracking RAW
« on: January 23, 2021, 07:17:07 PM »
Names_are_hard, this is a great start! Yes, this is what I’m asking for. Basically a quick “big pieces” roadmap that says how ML turned canon cameras into RAW video beasts.

I suppose when people join the forum to get started understanding ML, there isn’t a great source that lays it out quickly and simply. I have found that a quick explanation helps me wrap my head around how we got where we are, and the advancements made.

I think this could help clear up a lot of confusion for newcomers, and eliminate a lot of random questions in threads (of which I am guilty of too.)

Raw Video / History of ML cracking RAW
« on: January 23, 2021, 07:40:27 AM »
For those of us who are new, can a veteran of the forum provide a TLDR explanation of how ML achieves RAW video? And in layman’s terms as much as possible?

I think I recall someone eventually gained access to EDMAC (is that the right acronym?) How did we get there, and then what followed?

No, just thought maybe someone had a good insight from a previous experience. Thanks, really helpful though!

What would be the proper way for me to rename long clips (multiple 4gb split .MLV's) BEFORE importing into MLV app? Do I just need to change the name of all files?

I would use Exposure slider. This should fit better to any BMD LUTs. If it is just a starting point for manual correction, I would take whatever looks better.

Thanks! I notice that the “exposure” slider gives me more contrast than the “gamma” slider. It seems that “gamma” doesn’t alter contrast, but maybe raises the blacks?

If I want to keep processing as similar to what would be encoded out of an actual black magic camera, would the “gamma” slider keep multiple renders ‘consistent’?

I noticed too, that the stock “cineon” profile preset, doesn’t clip. Maybe I just use that from now on? Or should I use “LOG C”?

Why does the “BMD Film” preset want to clip so often?

Thanks again!

Gamma is one variable in the profile equation.
If the MLVApp profile is "Standard", the equation is:
outColor = inColor ^ (1/gamma)
while here gamma is 3.15 by standard. Other profiles are a bit more complicated... And gamma has different values for different profiles (often it is 1.0 as default).

Thanks for all the info MASC!

If I am getting shadow clipping with the standard "BMDFilm" Profile, should I adjust "Exposure" under the "Processing" menus, or adjust "Gamma" under the "Profiles" menus to avoid shadow clipping?

Done :)

Fixed problems with raw_twk & mlv_play modules on my D4/5D2 4k Crop_Rec branch .
Tested it in 3x3(1880x1258) , crop_rec 3.5k centered preset(2784x1160) & 3x1 4k anamorphic (4096x590)
there's all view ok in camera , except for 3x1 4k there noise/snow on the bottom half of the screen .
(the anamorphic part of the code is not vertically stretching the image need to look further in the code) but still viewable .
Make sure you load both module's in the zip file , that's it . when you what to view a file just press the > play button 

edit:Updated the first post of this thread with the mlv_play & raw_twk module download links also

Reddeercity, thank you so much sir!! 🙏🙏

1. Camera Matrix = Color calibration. Use = On, Don't use = Off. More info:
2. No. MLVApp always applies a curve to the RAW data, otherwise the result would look "strange". Gamma is one parameter of the math beeing done. Some more info:
3. ProRes4444 is available in Kostya (ffmpeg) and AVFoundation (Apple). It are just two different implemenations. ffmpeg is 10bit, Apple is 12bit. ffmpeg is available for all OS, Apple version is for OSX only.

Thanks for the info! Isn’t gamma 1.0 linear?

This might be a stupid question, but is there a 3x1 (vertical stretch) anamorphic preset to use the full width of the sensor? Would this theoretically reduce aliasing and moire the same as 3x1 (horizontal stretch)?

A few questions on exporting in MLV app.

Gear: 5D2 and reddeercity's latest Crop_rec build.

My goal is to get a file in a log gamma, as if it came straight out of camera that shoots log.

I have read the wiki here on export settings:

Heres the scenario,
-I import an MLV. I leave exposure alone, even if it was under/over exposed. I only adjust white balance if needed.
-Under "profiles" I select the "BMD Film" preset. (Does anyone have a suggestion of a "tonemapping" and "processing gamut" combination?)
-I leave "Allow Creative Adjustments" disabled.
-I leave "Gamma" set to "1.00"

Question 1: I kind of understand what the options under "Camera Matrix" do. But am still a little fuzzy. What are the benefits to "Use Camera Matrix" vs "Don't Use Camera Matrix"?
Question 2: Does leaving "Gamma" set to "1.00" basically mean MLV App won't make any adjustments? How is this different than using the exposure slider? What are the benefits to this adjustment?
Question 3: When selecting "Apple ProRes 4444," which "ffmpeg" selection should I select of the options? Options are "ffmpeg Kostya," "ffmpeg Anatolyi," and "Apple AVFoundation." What are the benefits?

Thanks all!

I tested the new mlv_rec module "" with the latest "" build. I'm loving the new 3x3 resolution!

mlv_play isn't working and causes no modules to load.

Any way to fix this easily?

Thanks again for your continued development!

Is there a way to get the 1880 res in the 5D2 nightly build?

I like the google docs idea!

Pages: [1] 2 3 ... 5