Author Topic: Dealing with Focus Pixels in raw video  (Read 103320 times)

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #400 on: October 07, 2017, 10:40:24 PM »
Are you using this map file? Erased top row?
http://nic.caucasus.net/fpm/?dir=&download=80000346_1808x726_dual_pass.fpm

I was trying to make my own but missed the part about 30 pixels at the top. All good now.

Need some 100D mv720 clips to try my MLVFS theory--if you want to test just use bouncyball's crop_rec 2-pass map file on mv720 clips.
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

Danne

  • Hero Member
  • *****
  • Posts: 3537
Re: Dealing with Focus Pixels in raw video
« Reply #401 on: October 07, 2017, 10:59:20 PM »
Quote
if it doesn't have an impact on the quality of the image or processing speed maybe that would be a way to get crop_rec working in MLVFS without having to swap out the map files?
+1

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #402 on: October 08, 2017, 12:29:47 AM »
Committed bouncyball's 100D crop_rec map file to the ML Focus Pixels repository.

Now for the instructions how to use this in MLVFS.

Grab that map file any way you want--here's a direct link to it. Right click, save link. Make sure it is named 80000346_1808x726.fpm.

Now copy it to your MLVFS contents. On the Mac MLVFS is located in your home Library/Services. Right click (control click on Mac) and choose Show Package Contents. Copy the map file in there. Sometimes the raw buffer is 727, sometimes 726 so make a copy of that map file and rename it 80000346_1808x727.fpm. Yes, I know there's already a file in there by that name, save it somewhere safe because you might want to go back to it if this experiment doesn't work.

Ok now--100D owners, shoot some crop_rec and some mv720 footage and check for focus pixels. Please report back.
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #403 on: October 08, 2017, 12:01:33 PM »
Oops--I missed that when I tried to re-create your map. It does clean up nicely in MLVFS using your 2-pass map and doesn't need any chroma smoothing in MLVFS.
Nice to hear. I was sure that you gone the way I did by yourself and just missed some details :).

I'm having problems with some of my scripts that I use to convert fpm to pbm and back but once I get your map converted to an image file I'll save that too.
Give a try to my 'fpmutil' it converts fpm->pbm->fpm in no second. Run './fpmutil -h' to get detailed help with examples. Note: you have to compile it because existing mac binary not updated and does not include the latest 100D crop_rec changes updated.

Also I'm sure you noticed header in the FPM. Header format is:
Code: [Select]
Sig  CamID    W    H   Crop program vers
----------------------------------------
#FPM 80000346 1808 726 1 -- fpmutil v0.5
and it's needed to convert fpm->pbm

If you want to convert your FPM to PBM you just need to insert this header as the 1st line of FPM and fill with appropriate values after '#FPM' signature with white spaces in between.

I could implement this header to MLVFS and make file name format like this: CamID_Width_x_Height_croprec.fpm. Had no time to do this yet.

Edit: unfortunately detection of crop_rec by RAWC header is not implemented anywhere yet.

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #404 on: October 08, 2017, 09:55:08 PM »
Wow, you took this topic to a higher level. I'm just now trying it out and it is lightning fast compared to my scripts. Have you considered submitting it to the contrib section of the official ML source?
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

Danne

  • Hero Member
  • *****
  • Posts: 3537
Re: Dealing with Focus Pixels in raw video
« Reply #405 on: October 08, 2017, 09:58:16 PM »

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #406 on: October 09, 2017, 09:05:04 AM »
@dfort
Glad you liked it :)
Now try the link Danne posted above. On the fly map generation is implemented to the mlv_dump itself. No more fpm files in in the mlv_dump directory needed.

Have you considered submitting it to the contrib section of the official ML source?
Nope, I have not yet.

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #407 on: October 09, 2017, 03:07:46 PM »
The 2-pass crop_rec map file is working so well with the 100D that I decided to do the same with the EOSM/650D/700D crop_rec map. The changes made the code much simpler.

Need to do some more testing but it should solve the hassle of having to swap out map files in MLVFS when switching between mv720 and crop_rec footage.
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3056
  • 5D3 / M1 / 7D / 70D / SL1
Re: Dealing with Focus Pixels in raw video
« Reply #408 on: October 09, 2017, 06:50:27 PM »
Damn @bouncyball's at it again. Keep on rolling and please never stop bouncing around!  ;D

To be able to get clean footage from cameras affected by Focus Pixels without the need of Chroma Smoothing is just godsend!
5D3.113 • 5D3.123 • EOSM.203 • 7D.203 • 70D.112 • 100D.101

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #409 on: October 10, 2017, 10:20:57 AM »
Keep on rolling and please never stop bouncing around!  ;D
Well... I'm trying ;)

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #410 on: October 11, 2017, 12:56:09 PM »
I was testing 2pass method on cameras other than 100D and discovered that 1st pass is not needed for 700D (only mv1080, no mv720). EOSM definitely needs it. What about 650D? I don't have the sample MLV. I guess it does not support crop_rec at all.


bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #412 on: October 11, 2017, 01:16:33 PM »
Good. Do you have some samples?

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #413 on: October 11, 2017, 05:35:15 PM »
...1st pass is not needed for 700D (only mv1080, no mv720). EOSM definitely needs it...

Interesting. Usually what works on on the EOSM works on the 700D and vice versa. We're close to getting the 650D working in crop_rec and my bet is that it behaves the same as the 700D. These are all of the "pattern A" cameras so once the tests are in we can make specific cases for the cameras that need the 2-pass treatment and those that don't need it--though with zoom mode I'm hitting areas that don't need it and it doesn't seem to hurt. Then there's the zoom mode on the 100D that doesn't show any focus pixels at all. Go figure.
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #414 on: October 11, 2017, 05:45:15 PM »
On second thought--it makes sense that the EOSM needs an mv720 pixel map pass because that camera is "normally" in mv720 mode except when recording H.264.
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #415 on: October 11, 2017, 05:55:14 PM »
I need more 700D (crop_rec/no crop_rec) samples. Can someone upload them?

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #416 on: October 11, 2017, 05:57:43 PM »
The funny thing is I never possessed/borrowed the camera affected by focus pixels :)

saulbass

  • New to the forum
  • *
  • Posts: 17
Re: Dealing with Focus Pixels in raw video
« Reply #417 on: October 12, 2017, 07:14:01 PM »
Hi Bouncyball - I have a 300mb mlv from a 650D running dforts latest crop rec experiment crop_rec_4k.2017Oct11.650D104.zip - it's 2512x1072. 14bit lossless compressed.
How should I pass it over to you - Hightail?


Danne

  • Hero Member
  • *****
  • Posts: 3537
Re: Dealing with Focus Pixels in raw video
« Reply #418 on: October 12, 2017, 07:33:31 PM »
Hi saulbass. Noticed you used Switch? You can shrink this file by creating a sample file package(zip). You do it from either (ms) mlv_dump_on_steroids or (m) mlv_dump menus:




saulbass

  • New to the forum
  • *
  • Posts: 17
Re: Dealing with Focus Pixels in raw video
« Reply #419 on: October 12, 2017, 08:41:35 PM »
Danne - thanks for the pointer - really useful to know - cheers!

dfort

  • Hero Member
  • *****
  • Posts: 2194
Re: Dealing with Focus Pixels in raw video
« Reply #420 on: October 12, 2017, 09:16:04 PM »
5D3.* 7D.* 700D.115 EOSM.* EOSM2.103

bouncyball

  • Senior
  • ****
  • Posts: 387
Re: Dealing with Focus Pixels in raw video
« Reply #421 on: October 25, 2017, 10:55:20 AM »
Hi Bouncyball - I have a 300mb mlv from a 650D running dforts latest crop rec experiment crop_rec_4k.2017Oct11.650D104.zip - it's 2512x1072. 14bit lossless compressed.
How should I pass it over to you - Hightail?
Sorry about very late response. It does not matter, just upload it somewhere and give the link.

Thx
bb