Messages

Hi
The very recent update i have installed in my camera (70D). Here i cant see any section to change the Bit depth . I dont even know what is the default BPP i am working with. sir  Pls answer it... as am unable to switch through 14/12/10 bpp.
regards

You have downloaded the latest nightly build update (it doesn't have 10-12bit yet).
So you will find the 10-12 bit depth build in experiments section under 10/12-bit RAW video (scroll down).
https://builds.magiclantern.fm/experiments.html

@OlRivrRat
Check the new build it solved this problem! thanks a1ex
Scroll down for "Raw video (MLV)" submenu and you will get the audio function in front of your eyes 

@OlRivrRat
1. Go to Modules menu and enable mlv_lite + mlv_snd
2. Restart camera
3. Go to Movie menu > select RAW video > Press Q button > You will find mlv_lite settings or submenu

Press Q

mlv_lite settings


If something like this happened

Restart the camera again and you will have it under mlv_lite settings
@a1ex Maybe this a small issue with new build it's only happen for the first time when enable mlv_snd. (EDIT: Solved)
(Tested on canon 700d build crop_rec_4k.2018Feb04.700D115)

magiclantern-crop_rec_4k.18-02-04.100D101

   mlv_snd Module is present & activateable but Audio Tab/Page is Missing.

Now it's under mlv_lite settings, check it out! 

I had this issue before on both mlv dump & mlv dump on steroids (Canon 700d).
Yeah mlv dump jump (1) every many frames and caused missed frame but actually the problem only affect the numbering of frames.
The missing frame is not missed at all, only jumped (1) forward causing blink between frames.
Fast solution I used: Select all of frames and rename to any character like (A) now Windows will create the frame numbers correctly. 

...UNcompressed 10, 12 and 14-bit rates...

... these uncompressed bit rates...

Bit depth, not bit rates 

[My question is]

My question is: can I just use Davinci Resolve (14) to edit the files after converting them?

Yes of course!
I am using MLVFS to extract mlv files into dng sequence and edit them directly in Davinci Resolve (14)!

On my 700D x5 crop mode at 1920x1080 in 8..11bit lossless, 23.976 fps the continuous recording depending on the how much detailed scenes you shoot and maybe ISO also.
Sometimes I get continuous recording sometimes didn't but I still have long recording times about 30 second to 3 minutes or more (It's depend). So It's not 100% continuous.
BTW I use 32GB Sandisk Extreme Pro 95mb/s.
EDIT: With audio of course, mlv_snd turned on.

It worked nicely on 700D
Also I noticed this

Your commit also let´s 1080 become 1082 every other time while scrolling for bigger aspect ratios.

We hope compile it with mlv_snd build.
thanks!

... If you want to take a quick look without having to output a file you should be able to pipe it through more.

Code Select Expand

mlv_dump -v 1736x1152.MLV | more
...Those are commonly seen at the end of a trimmed MLV. What file are you looking at? ...

Thank you!
I shot today a video with x5 crop mode at 14bit lossless resolution 1920x818 (14bit uncompressed works perfectly.)
The pixel dots pattern was different compared with full 2520x1072 resolution so no map worked for it.
Make your tests:
https://drive.google.com/open?id=1WdY7djRxC9tJjnJvQw_gQ5er30t_joKF

When I was shooting tests at 2520x1072 14bit lossless with PIXEL SCANNER pattern (Maybe a complex image to compress)
ISO above 100, I get a lot of data corruption and ASSERT**.LOG files compared to more normal scenes. If these files helpful for developing please tell me.

On Windows redirect mlv_dump output to a file and use a decent editor (Notepad++ or else) to look for "raw_info".
add

Code Select Expand


>>output.txt

to the command you want to execute

Thanks!

Hey @dfort How did you show raw information?
It's look like this after applying mlv_dump -v

mlv_dump -v

Code Select Expand

    raw_info:
      api_version      0x00000001
      height           1188
      width            1808
      pitch            3164
      frame_size       0x0039674C
  --> bits_per_pixel   14
      black_level      2047
      white_level      5586
      active_area.y1   28
      active_area.x1   72
      active_area.y2   1185
      active_area.x2   1808
      exposure_bias    0, 0
      cfa_pattern      0x02010100
      calibration_ill  1


with the exception of a few "bad" pixels. Tests on my 700D aren't showing anything like that so maybe you need to check your sensor?

Yeah I checked the sensor today I saw some dots on it, So the pattern is show perfectly the dust on the sensor

I'm not seeing the artifacts you pointed out. How are you processing your DNG's?

I tried both mlv_dump_on_steriods and MLVFS with new map but without chroma smoothing. After applying 2x2 chroma smooth the image is perfect clean. I am using Davinci Resolve 14 also ACR for comparing results.
I don't like chroma smooth because it's produce some more aliasing as I know?

The image needs some help with the blown out pink sky.

Any solution for pink highlights?

Short answer: it's Canon's imaging pipeline fixing these pixels; this only happens in 8...12-bit lossless modes (they use raw type 0x12 DEFCORRE, other modes use 0x10 CCD aka the first step in the pipeline).

Looking Nice

Did anyone notice something weird?
By changing bit-depth from 14bit lossless to 12bit lossless the whole pixels dots disappeared? (In whites & darks) and we get in very magic situation another new pattern in the edges only.
I don't know what the parameters had been changed to get this clean image, But what is the fu***** thing makes these pixels disappeared this way? White level? I don't know.
I really believe we are so close to forget pixels dots !
WHAT IS YOUR THOUGHTS MEN?

[Method 1 - In Camera]

Hey Magic Lantern world
This samples for each mod with another pattern: I called it PIXEL SCANNER pattern
https://drive.google.com/drive/folders/1X47f9foy6CdOiifndJSdFHyEcGWFDO2V

Because it's PERFECTLY shows hot/cold/dead Pixels maybe it will help for cameras have this issue heavily.
by doing script take this pixels out and save the pattern for each camera sensor for users then applying it to the raw video.
(Every camera will have it own hot/cold pixels and even if this the same cameras. from 700d to 700d will be difference.So maybe every user will have his own cold/pixel pattern if I am correct)

Tip: for mapping 12\11-8bit lossless Pixel Dots easily or to make sure all the pixels dots was mapped:
Shoot a raw video sample for each mod with new PIXEL SCANNER pattern (I played the pattern on 42 inch screen and I smoothed the focus a bit for decreases moire and show pixels dots a bit clearly). Zoom in the pattern if the screen was small.
Then process mlv file once for new map applied and once with no map applied. Import dngs sequences and put them above each other in any editing software now disable\enable the video on the top layer and see the difference before\after.

For red box only: I don't know if this artifacts or remaining pixels dots see below.

For artifacts problem here what I got: (This is 12bit lossless raw video)
New map applied:

I zoomed some areas:

Note: In the right part of sky this was overexposed so no artifacts on blown whites. And on the left-bottom corner in the horizontal white lines I don't know if this artifacts or remaining pixels dots. Here the original mlv make a tests:
https://drive.google.com/open?id=1hGJ6b-NH66mVFqtFIhnYzeTne9f83dmW

*A question: what is the process does MLVFS doing to remove this pixels dots?
By restoring the original pixels or changing the pixels dots to the safe pixels around pixels dots?

Affected cameras: EOSM, 100D, 600D, 650D, 700D, (and more?)
Method 1 - In Camera

I am somehow looking for this method.
I have question:
Is the pixels dots removing via Canon h.264 encoder or .cr2  .jpeg compression ? or the mlv_lite\silent_pic re enable somehow these pixels but the canon code disable it?
Maybe the encoder, reason: Enable proxy with mlv_lite you will have Clean H.264 and raw video with dots pixels in the same live view the same settings.
How does Framing mode in mlv_lite preview settings shows the dots pixels?
I am trying to find answer. If we, maybe we will see something like this:

Affected cameras: EOSM, 100D, 600D, 650D, 700D, (and more?)

@dfort
Really nice work man! it worked!
But unfortunately there are more pixels we couldn't see it. look like this:
https://youtu.be/7N5NgRBUWU8

Why we couldn't see them?
Because the pixels dots were behind the scenes in the white and green lines in the pattern
the edge only visible for us we can't see in the white/dark.

So I made the pattern flickering and I moved the camera slowly around the pattern to catch them but still too hard to see I am trying another patterns to make the view easier.

Is this really matter? I mean the most pixels was cleaned perfectly why we care for few Matrix Pixels
Because they were in my face and it will be in your face next time and in the people's faces that time so let's work on it.

Maybe it takes some time for me!

EDIT: I found it! Uploading the samples!
EDIT 2 : I was wrong this cold/hot pixels. SO PERFECT JOB @dfort thank you!

So right, Good luck 

MLVFS interpolation method is better then RAW2DNG. Try yourself switching '--fpi' method and you'll see a big difference

RAW2DNG interpolation method it's look like only soften the pixels dots didn't remove it In many different shots it wasn't good enough as MLFVS method.

Todo -- Shoot some simple silent DNG's using the various modes and measure the size of the full raw buffers.

I didn't have all this knowledge yet to do this things. So maybe I can shoot silent DNGs and upload it?

It's the same problem no improvement yet; only the middle was cleared.
I am using mlv_dump_on_steroids same as MLVFS method.
Any reason why?

I used both MLVProducer 3203v (a quicker way to see focus pixels, remove it and whatever)
and orginal MLV Dump & on steriods version. Playing with maps and comparing the results.
as a1ex said
yeah I am using MLVProducer too to see bit-depth by Numbers(black-white level maybe) very nice and fast for Couples MLV files with some darkening image issue(at 12  11-8bit lossless it hadn't solved yet)

This another MLV Samples at 14  12  11-8bit lossless to compare
https://drive.google.com/open?id=1rhTS1i4pbqi6lLceIT6Tp3B4Ci52k_WM
and it's looks same problem in mv720 with crop_rec
thank you hard workers!

Hello
I noticed today a small problem with 12/11-8bit lossless pixel dots (14bit lossless works fine)
The focus pixels only appears in Contrast edge image and in the whole image except flat dark or flat white parts
Used camera: Canon 700D with croprec4kmlvsnd.2017Oct23.700D115 build
ISO: 100
All was Shooted at 12bit lossless on mv1080 mode 1736x976
Examples with no focus map applied :
White out of focus:

Dark image:

Contrast Edge image:

And this with focus map applied: 80000326_1808x1190.fpm focus map (only the middle cleard)

Orginal MLV, DNG samples and Images here:
https://drive.google.com/open?id=1-TaNgr0ZTjQ_Ea4Q6tPjAZVTIW_7qSG0
If this problem discoverd before, Can you give me the Map for this pattern? I tried all the maps didn't work.

Hey a1ex or somone knows the answer
why we can't use 12or 10bit lossless for 720p mode
Can you explain?
My camera canon 700d

awsome!! realy nice work!! ❤❤
Yes it's smooth for me

PERFECT!

WLL DONE MAN!
Very nice work, i loved your style!
Did you use any 3rd plug-in in slow motion like Twixtor?
Can you share your settings and workflow (fps - shutter?)
❤❤