Author Topic: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter  (Read 958151 times)

tonij

  • New to the forum
  • *
  • Posts: 38
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1575 on: August 02, 2017, 04:47:33 PM »
Can somebody please explain to me how to use 'Fix Pattern Noise' with MLVFS?
When I turn it 'ON' and refresh the web page, it doesn't seem to make any visual changes to my DNG files. I tried in both Windows 7 and Mac without success.

Using MLV Dump I can successfully remove fixed pattern noise using a dark frame.
Example images:







dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1576 on: August 03, 2017, 01:05:26 AM »
Could be some caching issue. Might want to make sure you turn the option on very first thing before doing anything else, or even start MLVFS with it on via the command line (MLVFS does some internal caching, but the FUSE library or the OS might also be doing some caching that MLVFS can't do anything about).

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3413
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1577 on: August 03, 2017, 03:13:06 AM »
Have you tried updating the FUSE library in OS X yet @tonij?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

tonij

  • New to the forum
  • *
  • Posts: 38
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1578 on: August 03, 2017, 07:42:57 AM »
@DeafEyeJedi Can you tell me how I go about updating the FUSE Library? I'm not great with Macs

@dmilligan When I include "--fix-pattern-noise" in Windows Command Prompt it's applied successfully.

Is anyone successfully making these changes through http://localhost:8000/ on Windows or Mac?

Also how is MLVFS able to remove fixed pattern noise when I'm not giving it a suitable darkframe? Should I be providing darkframes if so how?

dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1579 on: August 03, 2017, 07:27:56 PM »
Also how is MLVFS able to remove fixed pattern noise when I'm not giving it a suitable darkframe? Should I be providing darkframes if so how?
http://www.magiclantern.fm/forum/index.php?topic=11787.msg158766#msg158766

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3413
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1580 on: August 06, 2017, 02:31:31 AM »
@DeafEyeJedi Can you tell me how I go about updating the FUSE Library? I'm not great with Macs

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

AneMotion

  • New to the forum
  • *
  • Posts: 4
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1581 on: August 12, 2017, 10:53:13 PM »
Hi guys. Does anybody know if there's a Windows 10 64 bit version of the MLVFS folder?
This current MLVFS_x86 does not work on Win 10 64.
Or is there another way to do this?







bouncyball

  • Contributor
  • Hero Member
  • *****
  • Posts: 850
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1582 on: August 13, 2017, 08:36:21 AM »
@AneMotion:

Look at this thread. Download windows binaries.
Also read this post and follow instructions mentioned there.
Don't forget to uninstall previously installed Dokany before installing newer one.

12georgiadis

  • Member
  • ***
  • Posts: 213
  • 5DmkIII - 7D - EOS-M
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1583 on: August 19, 2017, 06:04:43 PM »
Hello,

I just made some shot this week and when dealing with mlvfs, one file had a blue spot on it (seems to be a light). I tried all settings in MLVFS but cannot get rid of. Any idea ?


image hosting

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7701
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1584 on: August 19, 2017, 07:50:47 PM »
Maybe a hot or dead pixel. If nothing else helps it is possible to get rid of it by creating a pixel map file in Switch using imageJ.

12georgiadis

  • Member
  • ***
  • Posts: 213
  • 5DmkIII - 7D - EOS-M
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1585 on: August 19, 2017, 09:59:18 PM »
Maybe a hot or dead pixel. If nothing else helps it is possible to get rid of it by creating a pixel map file in Switch using imageJ.
Ok I'll Try it. It's very big in the Picture


Envoyé de mon iPhone en utilisant Tapatalk

sigurdneby

  • New to the forum
  • *
  • Posts: 14
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1586 on: August 25, 2017, 07:05:04 PM »
Excuse my ignorance, but I could not help to ask after trying countless times and not finding my answer in the nest of the thread. I just might be an idiot. Feel free to point me to page numbers.

I have earlier found MLVFS to be very quick, whether its dumping the DNGs directly into resolve or copying them to a drive - but now I no longer have that experience. The speed is at 0.4mb per second and Resolve is working awfully slow. Have tried updating FUSE, using both the virtual drive as well as the directed folder, I can't see the spinning wheel and I am on El Capitan 10.11.6

Cheers



dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1587 on: August 25, 2017, 08:23:48 PM »
What options do you have enabled? (some are quite slow)

sigurdneby

  • New to the forum
  • *
  • Posts: 14
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1588 on: August 25, 2017, 08:30:03 PM »
What options do you have enabled? (some are quite slow)

Vertical stripes and dead pixels - might not need the latter one. Will try to reinstall MLVFS now, the .MLV's are using quite a while to load in MLVFS, strange thing - always been very reliable!

sigurdneby

  • New to the forum
  • *
  • Posts: 14
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1589 on: August 25, 2017, 09:18:19 PM »
SOLVED - Reinstallation of MLVFS, FUSE, a good old restart and only vertical stripes ticked. Should have done all of this before crying, but I appreciate the attention!

EuAcelasi

  • New to the forum
  • *
  • Posts: 21
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1590 on: August 28, 2017, 10:37:39 PM »
Could anuboduy please explain ho to install on Windows 10

Ottoga

  • Member
  • ***
  • Posts: 203
  • The Ox is Slow but the Earth is Patient
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1591 on: August 29, 2017, 10:22:03 AM »
Just unzip the application to a location of your choice and run the app directly.

Everything that it needs is self contained within its folder. 
EOS 7D.203, EFS 55-250mm, EF 75-300 III, Tamron 16-300 DiII VC PZD Macro, SpeedLite 580EX II.

EuAcelasi

  • New to the forum
  • *
  • Posts: 21
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1592 on: August 29, 2017, 10:24:22 PM »
downloaded the 103 release... lunched the DokanSetup... Installation complete... what next? nothing new on the desktop or in the Explorer...

EuAcelasi

  • New to the forum
  • *
  • Posts: 21
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1593 on: August 30, 2017, 06:05:48 PM »
Sorry for asking stupid questions... I`m trying o install the on the fly Converter on Windows 10, but don`t understand exactly how... on x32 system you work in cmd prompt, but here... what are exactly the steps to take... I downloaded the latest version 1.0.3, installed the Visual Studio Comunity 2015 with SDK and WDK. Then lunched the dokanSetup file and it installed. How do I get to mount the virtual Z drive.  Please, may be anybody could explain explain step by step procedure... Thanks

magnesiumnitrate

  • New to the forum
  • *
  • Posts: 5
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1594 on: August 31, 2017, 04:52:51 AM »
Forgive me if this has been asked and answered, I couldn't find anything googling or searching the forum.

Is there any way to enable multithreading in the new MLVFLS that is compatible with 12/14 bit lossless? I'm running fix pattern noise and it's absurdly slow but only using one thread on one core so 100%/2400% in activity monitor. (12c/24t Mac Pro)

I saw some promising info with raw2cng that looked like it was forcing MLVdump to use as many threads as you told it to, but I have no idea how to go about modifying the script for MLVFS to make it work.

dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1595 on: August 31, 2017, 05:53:00 PM »
MLVFS is multithreaded, but not all algorithms can be parallelized (easily or at all). The fix pattern noise algorithm is an experimental algorithm written by a1ex. The implementation as written by a1ex is not easily parallelizable (or maybe not at all, IDK) per frame. However, multiple frames can be processed at a time, but you have to request them. So for example if you ask for one DNG and then wait til it's done to ask for the next one, you will end up waiting. Most programs that access files won't behave like that, b/c it's extremely uncommon for file access to be CPU bound.

If the real problem is that the algorithm is too slow, there are all sorts of optimization avenues to explore, not just multi-threading (vectorization, gpu/hardware acceleration, etc). But you will have to understand and analyze the code and algorithm to do any of this. Any optimization or other improvements to the implementation are welcome contributions.

bouncyball

  • Contributor
  • Hero Member
  • *****
  • Posts: 850
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1596 on: September 01, 2017, 09:28:18 AM »
Any optimization or other improvements to the implementation are welcome contributions.
+1 :D

magnesiumnitrate

  • New to the forum
  • *
  • Posts: 5
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1597 on: September 01, 2017, 03:52:57 PM »
I'm at best a script kiddie, so actually working the code and optimizing it is way beyond me. However, I will go on record saying I'm happy to do whatever testing anyone else needs, just shoot me a PM!

MLVFS is multithreaded, but not all algorithms can be parallelized (easily or at all). The fix pattern noise algorithm is an experimental algorithm written by a1ex. The implementation as written by a1ex is not easily parallelizable (or maybe not at all, IDK) per frame. However, multiple frames can be processed at a time, but you have to request them. So for example if you ask for one DNG and then wait til it's done to ask for the next one, you will end up waiting. Most programs that access files won't behave like that, b/c it's extremely uncommon for file access to be CPU bound.

If the real problem is that the algorithm is too slow, there are all sorts of optimization avenues to explore, not just multi-threading (vectorization, gpu/hardware acceleration, etc). But you will have to understand and analyze the code and algorithm to do any of this. Any optimization or other improvements to the implementation are welcome contributions.

samson33

  • New to the forum
  • *
  • Posts: 4
MLVFS for Windows 10 64bit?
« Reply #1598 on: September 02, 2017, 07:55:50 PM »
Is it possible to use MLVFS for Windows 10 64bit?
The thread "MLVFS for Windows" is deprecated.

Is it still possible and does a tutorial exist?

bouncyball

  • Contributor
  • Hero Member
  • *****
  • Posts: 850
Re: MLVFS - a FUSE based, "on the fly" MLV to CDNG converter
« Reply #1599 on: September 03, 2017, 01:53:46 PM »