Update 06.02.2016:
Please use MLVFS FUSE driver linked below, it will soon have builds for win32 that use dokany VFS driver.
dokany is open source, actively developed and allows to use FUSE drivers without API change.
(see: https://github.com/dokan-dev/dokany )
as long there is no official release, you can use this build (http://magiclantern.fm/modules/modules/mlvfs.exe/mlvfs.exe) after you installed dokany.
BR,
g3gg0
---
Hello,
inspired from the brilliant idea of the FUSE MLVFS driver (http://magiclantern.fm/forum/index.php?topic=13152.0) from dmilligan and ayshih, that allows you to mount MLV files as directories,
i wondered how to make their code/idea available to us windows users too.
The underlying system they use, called FUSE, is a file system extender for unix-like systems and wraps normal file calls so that an application can do arbritraty stuff with it.
In the case of MLVFS they simulate that MLV files are directories that contain DNGs. If you read the DNG from that virtual directory, they create it on-the-fly.
Unfortunately there is no real alternative for windows users to load the MLVFS daemon that is designed for FUSE.
But i found a simple way to give windows users the same experience as unix users get with MLVFS.
Back in my symbian OS days, i created a WebDAV server that allows symbian phones to mount directories on your windows computer. (see my old (http://www.g3gg0.de/wordpress/projects/webdavserver/) site)
So i could use my symbian phone to browse directories on my computer at home (MP3s and such).
I've added MLV support and browsing it as virtual folders! Should work from WinXP up to Win8.
Supported (generated) file types:
- 16 bit DNG
- JPEG for previews
- WAV in case of audio-MLV
- RAW FITS with metadata for astral photography (monochrome raw bayer mode) for e.g. DeepSkyStacker
- a text file containing all important metadata in human/script readable form
Features:
- you can select your MLV folder on HDD or memory card and browse it just like a normal directory - as soon there is a MLV, its simulated as directory
- any write access is redirected into a separate subfolder (<mlv_filename>.MLD), just like with the original FUSE driver
- overwriting and modifying the virtual files also possible - files get copied into virtual folder then
- deleting all files in the virtual folder will remove only the files in the .MLD subdirectory, so you will have a clean MLV again
- MLV files are *never* modified when doing stuff with files in the directory, except you delete the directory from its parent folder
- you can enable/disable any file type separately
Caching:
- it is currently disabled, due to memory issues :(
(i cannot catch out of memory exception properly, as it may happen anywhere)
(http://s9.postimg.org/h6lq1rmzz/mlvfs_webdav_4.png)
Select a drive letter that is free and press "Map", it will connect the share to a network drive.
You can also do it manually using the shell by typing:
net use x: \\127.0.0.1@8080 (change letter and port accordingly)
If you close the window, it will minimize into systray, showing a star icon and run in background.
It also supports that windows computers mount the shares as a local network drive.
So i extended this tool to act a bit more responsive and added MLV support using MLVViewSharp and the DNG code from dmilligans MLVFS daemon.
Now you can browse the MLV files as they were directories, showing you the frames as DNGs, JPGs for preview and WAV if it contains audio.
(http://s10.postimg.org/ht7yai9gl/mlvfs_webdav_1.jpg) (http://postimg.org/image/ht7yai9gl/)
You also can save files and folders "into" that MLV file. all files get redirected into a separate directory named like the MLV file itself, with an extra "_store" suffix
(http://s24.postimg.org/3xoh7h8mp/mlvfs_webdav_2.jpg) (http://postimg.org/image/3xoh7h8mp/)
Just like with the unix-version, you can use (hopefully) all your tools with that mapped network drive.
For instance here i import the DNG frames using LightRoom:
(http://s27.postimg.org/6wg34lv3z/mlvfs_webdav_3.jpg) (http://postimg.org/image/6wg34lv3z/)
Running WebDAVServer as Windows Service:
You can install the tool as a Windows Service which will automatically start on system boot.
To do this, first start the tool as Administrator (rightclick -&gt; Run as Administrator).
First set up all options like Path, Port and Auth – dont forget to press the "Write" button to save a default config.
Now you have written a default config that is always loaded whenever the server starts (both as service and as normal app)
To install the service, simply press "Install".
If this was successful, the "Install" button goes inactive and the "Uninstall" button activates.
The buttons "Start" and "Stop" are for starting and stopping the service.
Since the service has no GUI, sometimes it makes sense to stop the service and use the normal mode instead.
Web Browser Access:
You can access the server with your web browser and browse the contents of your share as the phone would see it.
There are some debug and log views too (check the links on top). If authentication is required (username/pass) the log/debug view is crippled to prevent abuse.
Accessing MLV content using the web browser is not implemented yet. Anyone who needs it?
Download:
Download the current version of the "MLV WebDAV Server" here (http://ml.g3gg0.de/modules/WebDAVServer.zip/WebDAVServer.zip)
Download the source code on bitbucket (https://bitbucket.org/hudson/magic-lantern/src/979cb95dc58bf3b2696ca9809fe91dfa9c113537/contrib/g3gg0-tools/WebDAVServer/?at=unified)
Important Hints:
Windows is per default very sluggish when accessing the WebDAV shares.
Please disable "Automatic proxy detection" in your internet explorer, like microsoft suggests here (http://support.microsoft.com/kb/2445570)
If you dont do that, accessing the mounted drive is very slow. Its a problem with windows itself.
And yes, its important also for chrome and firefox users ;)
If you want to use authentication on Windows Vista and above, you have to apply a registry patch that enables user/pass authentication.
Please install the fix from the microsoft article here (http://support.microsoft.com/kb/841215).
If you get DLL errors, you might have to install the MSVCRT runtime libraries from here (http://www.microsoft.com/de-de/download/details.aspx?id=40784)
Legals:
This program is licensed under the GPL v2 license.
This code contains GPL code from MLVFS (https://bitbucket.org/dmilligan/mlvfs/), a GPLed FUSE library for accessing MLV files.
To be specific, the whole RAW-&gt;DNG code was taken from there.
Wow really cool, I'll check it out!
Hope i can make this work. last time danne had to run a special tut for me to make me going :-X i am technology challenged
quickstart:
- start the exe
- click "Setup" tab
- click "Path" button
- select your card drive
- press "Write" button
- press "Map" button
- now you have a drive letter associated
you can close the window, it is running in background (systray, star icon).
rightclick star icon and press close to exit the tool
if you want it to autostart on reboot
- close the tool
- run it "as Administrator"
- press "Install"
- exit the tool (systray, rightclick, quit)
- now it will start on every reboot with the same settings
disable autostart on reboot
- close the tool
- run it "as Administrator"
- press "Uninstall"
- exit the tool (systray, rightclick, quit)
- now its gone
When running as administrator, pressing "Map" will hang the tool, so dont do it.
Some Windows issue, didnt check yet what the reason is.
I just tested as you described at the quickstart, I can't open the DNGs:
https://www.dropbox.com/s/8ddsb0cxdejjcbi/mlv_webdavserver_error_01.jpg?dl=0
What's wrong?
SOLVED, read the reply from g3gg0, #14.
Awesome. Got it working. First try failed since for the path I chose G:/ (my card drive) and came back with an error. Then chose the actual MLV file and wow!
Surami, can you upload such dng file?
Canon eos m, you should also be able to choose your memory card's root folder.
Which error did you get?
QuoteSurami, can you upload such dng file?
If I copy a DNG from the mounted "drive", its filesize will be 0 byte, so there is nothing inside.
https://www.dropbox.com/s/ol2r5lpmzxxqb02/M18-1424_000000.dng?dl=0
Now I'm uploading the source MLV file.
SOLVED, read the reply from g3gg0, #14.
redownload the server please and try again.
With the new build I see only empty MLV directories and the IDX files + at the WebDAVServer Log messages there are much from this kind of lines:
'System.DllNotFoundException' in connection from 127.0.0.1:50279 (HandleContent/HandleRequest)
Connection from 127.0.0.1:50280 (PROPFIND)
Here is the mentioned MLV:
https://www.dropbox.com/s/latxxeebzzufgr4/M18-1424.MLV?dl=0
SOLVED, read the reply from g3gg0, #14.
Did you extract all the files from the zip?
It looks like you extracted only the exe..
Yes, I downloaded the new build from here (http://ml.g3gg0.de/modules/WebDAVServer.zip/WebDAVServer.zip) and overwrote the files.
SOLVED, read the reply from g3gg0, #14.
Where did you save it to?
How did you start it?
Which windows version?
QuoteWhere did you save it to?
I saved it to another HDD (D:\), not on the same where my MLV files are (E:\)
QuoteHow did you start it?
Just double clicked on the WebDAVServer.exe. (I have administrator rights)
QuoteWhich windows version?
Windows 7 (64 bit)
Makes the WebDAVServer other files/modifications outside the (eg. D:\WebDAVServer) directory? I mean WebDAVServer settings etc. not the MLV folders, IDXs.
May I delet or clear something somewhere on the system?
I found the cache files, they are at this location: %systemdrive%\windows\ServiceProfiles\LocalService\AppData\Local\Temp\TfsStore (source (http://support.microsoft.com/kb/2790804))
SOLVED, read the reply from g3gg0, #14.
1) redownload again, the DLL shoould be from 22:05 and try again
2) if the problem persists, try installing the MSVCRT runtime from here (http://www.microsoft.com/de-de/download/details.aspx?id=40784)
WebDAVServer only writes a WebDAVServer.cfg file with its settings in its startup directory.
Please start it from there using a doubleclick, if this was the problem (should not be)
it does not require any write permission - only if you want to save files on your shared folders.
Many thanks g3gg0 and of course thanks for dmilligan, ayshih, a1ex, chmee, baldand and other developers too.
I got proper DNGs on the virtual drive with the new build (22:05) + installed MSVCRT runtime '13 + after manually cleaning the cache files, what were generated by the older build.
I can't open the sequence directly with PP CS6, but dynamic linked through AE CS6 it works.
Resolve 11 Lite crashes the WebDAVServer.
i've optimized the DNG bitshifting code, its a bit faster. redownload please.
i also added SSE2 optimized libraries, just copy the one from the "SSE2-Library" subdirectory into the main dir.
yes, overwrite the existing one, you can copy it from the "Standard-Library" directory later again if you need.
the SSE2 one requires about 5 ms per image, where the standard unoptimized one took 17 ms.
but all the network stuff still takes ~45 ms, will check what i can optimize there.
@surami:
why does it crash?
any more information?
you can use your browser and navigate to http://127.0.0.1:8080/log (replace with your port)
there you see "Request messages" and "[Start]" link below. dont click it yet.
1) start your tool that crashes
2) do everything so its just a buttonpress away from crashing
3) press the [Start] link in your browser
4) make the tool crash
5) press F5 in browser
6) copy all messages to pastebin.com or anything like that
I used now the SSE2 optimized version, it's a bit really faster, but this crashes too in Resolve Lite.
Quotewhy does it crash?
any more information?
I mounted 6 MLVs (2-3 seconds long shots, each around 150 MB) to the virtual drive.
Started Resolve Lite and on the Library tab I started to play them back one after another (the playback isn't realtime, it's choppy).
The first was ok, the second too, but at the third came the window, that WebDAVServer crashed (.
I could log the things till the crash, but after that I can't refresh it (because the server stopped).
So I can't get the information from the log to send for you.
If you can implement such kind of thing, which saves the log in txt file, when the server stops, then I can send something.
ah okay misunderstood you. thought your resolve crashes.
thats a different story, my wrong.
what error message? just exiting? screenshot?
does it only happen with the *same* file, or ist it "the third one" being played?
redownload and repeat my instructions.
if it suddenly crashes, check for a "WebDAVServer.log" and upload it.
if it doesnt crash, check the log messages for exceptions.
Quote from: g3gg0 on September 11, 2014, 06:12:33 PM
Surami, can you upload such dng file?
Canon eos m, you should also be able to choose your memory card's root folder.
Which error did you get?
Hi g3gg0 sorry for not responding earlier. My problem was solved following your instructions - as always clear :)
What I meant (sorry for not being clear) is that when you sent me the instruction to link to the path, I kept trying to link to the root but soon figured out to link to one of the MLV files in the target sub folder. In fact that is why I qualified my post by saying 'awesome' and 'wow' ;) :D
Will redo load and try now. I already feel like an expert on this to topic!
So you can choose e.g. G:\ as folder in WebDAVServer and it works?
Thats how I use it.
Quoteredownload and repeat my instructions.
if it suddenly crashes, check for a "WebDAVServer.log" and upload it.
if it doesnt crash, check the log messages for exceptions.
It doesn't crashes now (SSE2 version), there aren't any exceptions at the log tab of WebDAVServer and there isn't any "WebDAVServer.log" file generated, so I think it works well now with Resolve 11 Lite. I didn't made the test in PP CS6 dynamic linked with AE CS6.
Another 3 things what I discovered:
1. I constantly watched the cache folder (C:\Windows\ServiceProfiles\LocalService\AppData\Local\Temp\TfsStore\Tfs_DAV) at playbacks and the stange thing is here:
https://www.dropbox.com/s/18s62rphzej0e3x/mlv_webdavserver_error_02.jpg?dl=0
As you can see, on the left side (in cache directory) the ending numbers of DNGs aren't correct, they are 7 digit long, there is an extra "0" at the end + there are some uncorrectly generated DNGs at the end of the directory. Right side is the mounted server (virtual drive).
2. Previously I mentioned, that In Resolve 11 Lite the playback isn't smooth. But now I discovered, that it plays back smoothly if the actual file in the middle box is played and on the left box an another directory is selected.
https://www.dropbox.com/s/vojt2rqxwc5ek1x/mlv_webdavserver_error_03.jpg?dl=0
Quote from: g3gg0 on September 12, 2014, 07:49:45 AM
So you can choose e.g. G:\ as folder in WebDAVServer and it works?
Thats how I use it.
No, if I choose plain G:/ for example it doesn't work gives an error. Will try to replicate when I am home. Worked for sure when I chose one of the MLV files in the sub folder on the card and then all filed were converted.
@surami:
1. i dont have to do anything with the cache folder. its windows-internal.
2. interesting. is this repeatable?
@Canon eos m:
screenshot please, there should be no error. of course you have to select a valid drive letter..
1. Ok, I understand.
2. Well it was because of the cached files, so they were there yet at the playback, thats why it was so smooth.
I write this because now I tested again with random directory swith + random file playback and its not smooth, so it's a cache thing.
updated:
- reads now MLV and RAW
- shows MLV information tags (LENS, etc) in _info.txt and as virtual files
- less trouble with some older files
Thank you for the RAW support, this will come in handy for the RAW files from bolt trigger! :)
Hi and thx for the development. I can mount the MLVs but the DNGs are 0kb big. The Log says:
[E] 'System.DllNotFoundException: Unable to load DLL 'MlvFsDng.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E)' in connection from 127.0.0.1:62572 (HandleContent/HandleRequest)
But the .dll is in the direcory. Maybe somebody can help... THX
Does it mean that with this "tool" I will be able to read my Raw / MLV files directly with Resolve without extracting "Dng's" ?
Francis
Yes! That's the whole point :)
@francis:
Yep, just select your cards root folder or your mlv storage directory as root, then map the drive and they appear as directories with jpg and dng.
@domidomsen:
Windows Version, x86 or x64, did you install msvcrt runtime as explained a few posts earlier?
I did not have vcredist_x64.exe installed. I do now. But its still not working. same Error. Its Win7 64bit. Thx
Thats odd.
Can you try again with the dll from the standard subfolder?
The path where all files are in doesn't contain spaces?
Short feedback after installation: the tool works (what kind of wizardry is this? ??? ).
Playback in Resolve is choppy in my case - I'd say around 0.5 fps, but it's most likely because of suboptimal hardware platform (i7 920 @2.66, 6GB RAM, W7 64).
Attempt to open MLVs in Premiere ends with "File format not supported" message.
Didn't experience any problems during setup process.
Thanks a lot, g3gg0.
No problems for me on win7 64bit. :)
@domidomsen:
please redownload, try and post a log with the exact error message
@all:
i added caching and prefetching.
it should be a bit less choppy now :)
So, the path had a space. But now it doesnt. But still not working. I also downloaded the newest version. Here is the log:
Statistics:
MLV readers: 3
D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M11-2042.MLV: Cached 0 files, 0,00 MiB
D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M12-0034.MLV: Cached 0 files, 0,00 MiB
D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M11-2354.MLV: Cached 0 files, 0,00 MiB
Cached toal: 0,00 MiB
[i] WebDAVServer started.
[i] Listening on 0.0.0.0:8082
[i] Root path 'D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\'
[E] 'System.DllNotFoundException: Unable to load DLL 'MlvFsDng.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E)' in connection from 127.0.0.1:61151 (HandleContent/HandleRequest)
[E] 'System.DllNotFoundException: Unable to load DLL 'MlvFsDng.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E)' in connection from 127.0.0.1:61153 (HandleContent/HandleRequest)
[E] 'System.DllNotFoundException: Unable to load DLL 'MlvFsDng.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E)' in connection from 127.0.0.1:61157 (HandleContent/HandleRequest)
It is faster, indeed, however now I have more skipped (black or blank) frames during timeline playback. Seems that hard drive can't write data fast enough (disks not in RAID).
With previous version there was maybe 4 or 5 black frames in total, now it's like 20% of all.
Again, this comp is far from being an editing machine, so just want to confirm that everything seems to work as intended ;)
update, added some parameters for cache tuning and removed dependency to MSVCRT.
@domidomsen:
can you try again?
All the same. But at least I have a new error massage:
Statistics:
MLV readers: 2
D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M11-2042.MLV: Cached 0 files, 0,00 MiB
D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M12-0034.MLV: Cached 0 files, 0,00 MiB
Cached toal: 0,00 MiB
[i] WebDAVServer started.
[i] Listening on 0.0.0.0:8082
[i] Root path 'D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\'
[E] 'System.IO.IOException: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.' in connection from 127.0.0.1:64611 (HandleContent/HandleRequest)
I checked the last version and I'm afraid you need feedback from someone with a higher-end editing station, to reach some conclusions.
Now, with default values, I get only flashes of single frames on timeline, the rest is skipped. HD spins like crazy, obviously can't deal with so much data. I didn't try to change the caching parameters, yet.
@domidomsen:
there are no traces of dll errors, jusdt one socket error.
you are 100% sure that the MlvFsDng.dll is in the same directory as WebDavServer.exe and MLVViewSharp.exe and NAudio.dll?
@LRF:
if you play the second time, is it better?
I cleaned caches and mounted MLVFS again.
Without render cache in Resolve, it takes 50 seconds to play 10s MLV clip for the first time, 44 secs for the second time. But second play keeps the same omitted frames pattern as the first one. Now it takes long to render frames at the beginning, then more or less in the middle longer black gaps appear, and last third of the clip plays black.
With Smart Render Cache, after waiting for clip to be cached, it takes 22 secs to play it. But again, black or omitted frames seem to appear in the same moments, like when Resolve cache was disabled. Second play looks the same.
Its the same file structure like in the ZIP. I tested it on a friends system. Its the same. 0kb DNGs. Sorry :'(
But his error is different:
Statistics:
MLV readers: 2
C:\Users\joe\Desktop\100EOS5D\M12-0009.MLV: Cached 11 files, 1,39 MiB
C:\Users\joe\Desktop\100EOS5D\M12-0007.MLV: Cached 11 files, 1,26 MiB
Cached toal: 2,65 MiB
[i] WebDAVServer started.
[i] Listening on 0.0.0.0:8082
[i] Root path 'C:\Users\joe\Desktop\100EOS5D\'
[E] Error while browsing /M12-0007.MLV/M12-0007_000002.dng: System.DllNotFoundException, Die DLL "MlvFsDng.dll": Das angegebene Modul wurde nicht gefunden. (Ausnahme von HRESULT: 0x8007007E) kann nicht geladen werden.
Again: Same structure like in the zip.
can you start it as administrator?
please start a command shell, change into the directory where the dll/exe are and do
"dir /n /r /x /q" and upload a screenshot please.
I started it as Admin.
Here is the screen:
https://www.dropbox.com/s/rpy7xavc7c2jycr/screen.jpg?dl=0
its getting weird now...
can you try this (https://web.archive.org/web/20081204134630/http://www.stillhq.com/aus-dotnet/archives2/msg00033.html) solution?
basically you have to remove and re-add EXEC permission to the folder where the EXEs are in.
another update: switched down to .NET 3.5.
maybe it works better on your machines.
do you have some antivirus installed?
Hi G3gg0, I am away till next week. I will check than. Thx for your help.
I'll give it a try later today. Thanks.
Everything that might have reduced performance was off, as far as I remember.
Testing new update.
Antivir and other stuff - off
Power plan - High performance
10s MLV clip (almost static scene)
Resolve render cache off:
first play - 1 min 12s (approx 50% of black frames)
2nd - 30s (80% black frames)
3rd - 12s (only few frames visible, the rest is black)
With Smart render cache:
1st play - 24s (approx 10% of frames visible, rest is black)
2nd - 24s (few frames visible)
3rd - 24s (few frames visible)
When cursor is randomly placed on timeline, if the that frame was black during playback, remains black. Doesn't show preview.
So, in my case, too many bottlenecks to review the app properly. GTX 275 with 850MB VRAM and 7200rpm 1TB HD is OK for H264, but not in this case. Let me know if I can help in some way, but I think my results are not representative because of hardware limitations.
okay i would say anyway that this solution is not meant for realtime playback etc.
is it really necessary for post processing?
Hmm... I'd say that if it wouldn't be possible to have realtime playback regardless of computer parameters, then it becomes quite problematic.
If one can't see the edit or color corrected clips in realtime, usefulness of such solution is rather limited, in my opinion.
update: speeded up code to probably maximum possible speed using network sockets :)
now a GET request takes 27 msec, and 25 msec are "writing the DNG to the socket"
set prefetch images to 100 or more for your tests.
next optimization step: check why disk reads are somewhat slow
I wish I had good news, but...
Prefetch set to 150.
It took 3 minutes 7 seconds to play the clip. A lot of frozen frames, jumps, and blacks. Practically no playback at all. This time also some pink artifacts like horizontal lines and parts of the frame in stylish "pink and white" color palette ;)
At the end Microsoft .NET Framework has reported unhandled exception.
************** Exception Text **************
System.ArgumentOutOfRangeException: Value of '1004' is not valid for 'Value'. 'Value' should be between 'minimum' and 'maximum'.
Parameter name: Value
at System.Windows.Forms.ProgressBar.set_Value(Int32 value)
at WebDAVServer.WebDAVServerForm.RefreshBar()
at WebDAVServer.WebDAVServerForm.UpdateTimer_Tick(Object sender, EventArgs e)
at System.Windows.Forms.Timer.OnTick(EventArgs e)
at System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m)
at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
After that Resolve refused to cooperate. Damn :D
confirmed, that the crash may happen.
fixed it.
can you open your browser, enable request logging and look for the GET ....dng requests, how long they take?
Quote from: g3gg0 on September 18, 2014, 11:42:04 PM
can you (...) enable request logging and look for the GET ....dng requests, how long they take?
If you tell me how to to it, of course.
I tried to figure out what am I supposed to do, but have no clue, sorry.
- browser: http://localhost:8082/log
- click [Start] at the bottom of the page
- play some files
- check WebDavServer window (or browser) for logged GET data
Here are some values from the beginning of the log:
412,0236 ms
470,0268 ms
1531,0876 ms
1585,0907 ms
2219,1269 ms
2263,1295 ms
451,0258 ms
2981,1705 ms
5494,3143 ms
5596,3201 ms
2016,1153 ms
2953,1689 ms
596,0341 ms
424,0242 ms
186,0106 ms
553,0316 ms
10284,5883 ms
Prefetch 150, no render cache in Resolve.
Smallest value i noticed is 52,003 ms. Biggest, the last one in log, is11354,6495 ms. The numbers seem quite high. Did I win something? ;)
wow is that slow oO
if you view the files' properties using the explorer, what do the numbers look like?
If you mean MLV file i used for the test, it's 767 MB, 10 seconds 9 frames long. No color correction applied.
na, browse the virtual MLV directory where the DNGs are and do a rightclick, properties on a few DNGs one after another.
this should trigger a GET command and you will get again log entries.
tell me how long these GET requests took.
They look like this:
312,0006 ms
62,4001 ms
62,4001 m
62,4001 ms
62,4001 ms
78,0001 ms
78,0001 ms
78,0001 ms
78,0001 ms
15,6 ms
0 ms
31,2 ms
78,0001 ms
The file is in mapped folder on a hard drive. OS and apps are on separate disk in different partitions.
oh in this case...
your machine is way slower than mine.
i guess that is the problem :(
Yep, that's what i suspected. So far, for h264 it was more than enough. But since I started experimenting with RAW recently, looks like it's time for serious upgrade.
Anyways, thanks a lot, g3gg0.
I'm making some more tests, checking if location of mapped folder makes any difference. Just noticed, that times can go as low as 10ms or 20ms, and then for example 80,000 for several times, and then again 10. Will let you know if I reach any conclusions.
thanks that will help a lot.
dont have any tools that could play dng :)
(http://h:/flickr%20upload/g3gg0-mlvfs/error)
getting this error. what can I do
Edit: don't know how to attach pic so directly typing the error:
SW: Adobe After Effect 2014
Error: After Effects error: File exists but couldn't open for reading "\\127.0.0.1@8082\M12-1507_000022.jpg". (3::0)
File format: .jpg
Error after pressing import in Ae file menu
Error 2: File 'H\5D3\20140912\M12-1558.m00' has an a invalid block at offset 0xB192BF34
ok will check this tomorrow.
meanwhile i've added raw FITS support (e.g. DeepSkyStacker reads such files)
major bugfixes:
- reworked file accesses as sometimes it has thrown access exceptions on rapid accesses
- changed buffering to butter at most 500MiB to prevent memory exceptions
- tweaked network socket settings to squeeze out the last milisecond ;)
@Canon eos m:
can you try again?
@all:
overall performance should be better now. can you playback now in realtime?
I didn't finish previous tests, so still don't have precise data, but it might be insignificant since I didn't manage to get realtime playback with previous build anyways.
With this build still no luck with realtime, but numbers seem to be lower.
Here's data from "GET" properties in Explorer:
283,0162 ms
321,0184 ms
2,0001 ms
3,0002 ms
3,0001 ms
4,0002 ms
3,0002 ms
3,0002 ms
3,0002 ms
0 ms
0 ms
0 ms
0 ms
0 ms
15,6 ms
0 ms
0 ms
0 ms
Precache set to 150.
Where there is 0 ms, I was still getting preview and properties without problem.
In Resolve it took 36 seconds for first play. But there as a lot of skipping and black frames. Second half of the clip black. Some error and .NET crash at the end, so wasn't able to collect results.
I also benchmarked the storage hard drive, and more or less it keeps manufacturer's parameters: Average Seek Time 8.9ms (10.3 in my case), Average Latency 4.17ms, Interface SATA 3.0Gb/s, 1TB 7200 RPM, 32MB Cache.
But since it's obvious that the whole system can't cope with such amount of data, my results might be totally misleading.
@Canon eos m:
can you also provide the output of a mlv_dump -v for the file causing trouble?
g3gg0 really sorry for not re-testing the mlvfs win version after you worked to refine it. It is already 2:06 am in Singapore and I am still pre-occupied with office work. I should be done by tonight and promise to test the refreshed version of mlvfs first thing tomorrow morning and report back to you soon after.
Apologies again.
Hi g3gg0,
Similar error:
After Effects error: File exists but couldn't be open for reading: "M:\M30-0919.MLV\M30-0919_00000.dng" (3::0)
This error comes after the RAW file opens automatically in ACR 2014 when I use After Effects CC 2014 import sequence function.
M:/ is the virtual drive that MLVFS created for me. I can view the file by clicking on any one of the dng frames since MLViewer automatically activates. The file all blue though.
To trace steps:
1. I downloaded the latest zip version of the WebDAV Server 2.9 from the link on page 1 of your post
2. I then unzipped this folder
3. Clicked on WebDAV Server file and was taken to the interface
4. Clicked on the Map button and the interface created M:/ virtual directory on its own
5. Clicked on the Path button and directed the interface to the folder containing MLV files
6. Clicked on Write and Install in quick succession
7. Opened sub-folder in M:/ and clicked on one of the many dng frames
8. The frames automatically opened as a video in MLViewer
9. Closed MLViewer
10. Opened After Effects CC 2014
11. Clicked on the Import command and clicked on the first dng frame in the sub-folder in M:/
12. The frame opened in ACR 2014 RAW interface
13. Since the frame was blue, I color corrected it using the Auto WB button in RAW
14. Closed the file
15. The import error was seen on the AE screen
This is worst than last time since the last time the import stopped after brining in about 50 frames - now none was imported.
Edit: Sorry just noticed your message:
@Canon eos m:
can you also provide the output of a mlv_dump -v for the file causing trouble?
How do I create a mlv_dump -v for the file causing trouble
Second error:
"After Effects error: the file format module could not parse the file." (45 :: 35)
Third error when I tried to import the jpg sequence:
"After Effects error: Can't import as a sequence. Found no matches for the selected file name." (39 :: 44)
The files are definitely there but AE can't see them.
There is something wrong with the DNG because Adobe cannot recognize these DNG files where as the jpg's are okay.
g3gg0 on the money once again! Will try pretty soon and report back. Bowing to what you're doing man...
Another one:
WebDAVServer started.
Listening on 0.0.0.0:8082
Root path 'E:\Diplomarbeit\'
[E] Error while browsing /Rohmaterial/20140823 - Pizza/Kamera1/M22-1621.MLV: System.ObjectDisposedException, Auf einen geschlossenen Stream kann nicht zugegriffen werden.
I get all empty MLV Folders (it does take some time to open thought so it does try to do something), tried as Admin and Local, Service and Standalone. I'm on Windows 8.1
wow, this is a weird error..
other mlv's work?
can you provide one of them?
So its me again ;)
Statistics:
MLV readers: 2
D:\UBIKMEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M11-2042.MLV: Cached 0 files, 0,00 MiB
D:\UBIKMEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\M11-2302.MLV: Cached 0 files, 0,00 MiB
Cached toal: 0,00 MiB
[i] WebDAVServer started.
[i] Listening on 0.0.0.0:8082
[i] Root path 'D:\MEDIA\2014-Vitali_Video\06_FOOTAGE\02_VIDEO\RAW-ALL\'
[E] Empty request in connection from 127.0.0.1:57654 (HandleContent/HandleRequest)
[E] Empty request in connection from 127.0.0.1:57667 (HandleContent/HandleRequest)
[E] Error while browsing /M11-2302.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] 500 'System.IO.IOException: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.' in connection from 127.0.0.1:57687 (HandleContent/HandleRequest)
[E] Error while browsing /M11-2042.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] 500 'System.IO.IOException: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.' in connection from 127.0.0.1:57686 (HandleContent/HandleRequest)
[E] Error while browsing /M11-2302.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] Error while browsing /M11-2302.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] Error while browsing /M11-2302.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] Error while browsing /M11-2302.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] Error while browsing /M11-2042.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
[E] Error while browsing /M11-2042.MLV: System.ObjectDisposedException, Cannot access a closed Stream.
The Folders are empty. I use version 2.9
Thx
Nope, no mlvfile or folder works, they're all empty.
Interesting though: Double Clicking on a mlv folder plays the audio of the clip for the blink of an eye. It also generates the idx file and the included MLV Viewer playedthem correctly so no problem there.
Ill try to build the bitbucket project tomorrow and look into the exceptions myself.
Here's one of the files:
https://www.dropbox.com/s/r7bn2num691bl4q/mlvtest.7z?dl=0
Generally asked: Is MLVFS the way to go now? I'm currently making shooting with ML-RAW and postprocessing the files my diploma thesis, but you guys are so fast with new ideas and techniques that I cannot keep up and track :P
thanks for the file.
@domidomsen:
@Podden:
can you redownload and test?
Cool it works. Almost ;)
When i open the DNG`s the lower 18 Pixels are missing. They are black.
Thank you.
uhm are they blacked out?
or is there an additional black bar on bottom?
A black bar at the bottom.
Hi,
Hi,
I haven't been able to use the server at all...
With what Windows version are you using it?
I'm with Windows 8 and I don't know if this could be the cause of all my failing...
I launch the server with administrative rights, tried to use the "Launch as Windows 7" feature of Windows, but doing all of things always lead me to an error when trying to map the drive :
"Sorry, mapping the drive failed with error 53"
Am I doing something wrong ?
I also tried to configure various Paths : with one MLV in a directory, the root path of a drive...
Thanks in advance.
Nice file access works now like a charm. However, I've got these black bars, too.
here's an example dng:
https://www.dropbox.com/s/hvtpikxdtt6rpoh/M22-1922_000001.7z
Hi,
I have install this for the first time and the folders they are all empty. Anyone knows why this happen? Later i will post more info about the empty's folders.
The lest version for download already have the strips correct?
Well... for the one's that find the same error or did something wrong, like me.
I try to delete the folder with the app but it says that is using in other place. So i search in windows for the regedit.exe, click it and went to HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\WebClient\Parameters\SYSTEM\CurrentControlSet\Services\WebClient\Parameters\ and deleted the folder WebDavserver. Then deleted the folder of the app in the desktop and replace with fresh download. Re-start the pc and voila, everything looks alright. Wend i go to my virtual drive the ML folders contain all the files, everything is there =) So happy !!! Let's try in Premiere...
Quote from: arrinkiiii on December 18, 2014, 04:28:32 PM
Hi,
I have install this for the first time and the folders they are all empty. Anyone knows why this happen? Later i will post more info about the empty's folders.
The lest version for download already have the strips correct?
samething happen wth me
Did you already fix that andy kh ?
no not yet. i don kno how to fix and i hv been busy trying to fix another pro. for some reasons resolve crash while importing xml from premiere pro cc. after cutting cdng in premiere pro i export xml and for the first time i m unable to import xml or edl in resolve 11 lite
Im trying in Premiere CC and is very slow. I search for the files in Premiere browser and it take a lot of time to recognize that is a file, after i import it to the project and move to the time line (also take a little of time) i try to render the file for be able to play normal in Premiere and it gives me a error saying "Error Compiling Movie - Unknow Error"
Going make more some trials.
andy:
I try to delete the folder with the app that i have put in the desktop of win7 but it says that is using in other place. So i search in windows for the regedit.exe, click it and went to HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\WebClient\Parameters\SYSTEM\CurrentControlSet\Services\WebClient\Parameters\ and deleted the folder WebDavserver. Then deleted the folder of the app in the desktop and replace with fresh download. Re-start the pc and voila, everything looks alright. Wend i go to my virtual drive the ML folders contain all the files, everything is there =)
now im not able to map. i m getting error 53 msg
ohhh, ok, its a different error. What i can advice is to read the 4 pages from this post and try getting a solution. Soory for not be able to help more =(
Don't know if is my version of Premiere CC but the import and browser is very slow. By the internet browser is ok, it's kind of fast. Just un-able the search for lan/server in explorer settings, like g3gg0 suggested.
HI
I have win 7 x64 and cannot use webdav server. I open it an d it always get me the error while pressing the drive letter MAP button. It retunrs the error : mapping the drive failled, error 53. I tried all possible letters....same result.
I did all the tricks and after those I see now, even if I run as adminsitrstor I got WEBDAV server NOT started. windows service is already running.
Quote from: phil7 on January 24, 2015, 05:44:39 PM
HI
I have win 7 x64 and cannot use webdav server. I open it an d it always get me the error while pressing the drive letter MAP button. It retunrs the error : mapping the drive failled, error 53. I tried all possible letters....same result.
I did all the tricks and after those I see now, even if I run as adminsitrstor I got WEBDAV server NOT started. windows service is already running.
Same thing I reported in october. I am using Windows 8 64 bits...
As almost no one reported this, I guess we are on our own.
Hello,
is there an alternative download mirror?
Quote*** UnKnown can't find ml.g3gg0.de: Non-existent domain
edit:
Compiled it for myself, although there were a few problems (one being FITSCreator missing, I commented out the lines)
Hi
i am using MLVFS a lot on my desktop computer (win 7 64bit) and after mounting MLVs i can import them to premiere cc without any problems as a sequences. Recently i have bought a laptop with windows 8 64bit, mounting works ok but unfortunatelly i cannot import DNGs directly to premiere anymore. It says "unsupported format or damaged file". I can import CDNGs from raw2cdng though. Is it possible to fix this somehow? Going through raw2cdng every time is time and HDD space comsuming, i love the MLVFS fast workflow from my desktop computer because I can work directly from CF card - just mount the MLVs, import them to premiere, than to resolve for cc and export final movie. Fast and easy.
So is that mean that MLVFS works differently on win 7 and win 8?
I have exactly the same versions of premiere CC on both computers.
I have also noticed that MLVFS on win 7 during mounting creates MLV and MLD folders on card while on win 8 only MLDs are created on card. MLV folders are on main C:\ drive in "volumes" folder.
Hi kgv5, what is you specifications for your desktop computer? Are you using VirtualBox in Windows 7?
hi arrinkiii, i dont know really... i dont remember installing such thing. Laptop is brand new with not many things installed, only those needed for raw workflow.
Does anybody here usues MLVFS on windows 8 64bit and is able to mount mlv files and import them to premiere cc directly? (as normal DNGs, not CNDGs)?
ahhh, ok. You install the MLVFS for windows, i have install one time but didn't work so good in my win 7. I Install the Mac version in my BookPro =)
No download...
no download! may you please correct the link?
Quoteno download! may you please correct the link?
https://bitbucket.org/dmilligan/mlvfs
@vertigopix
thanks, i installed Pismo File Mount Audit Package. but how should i register "mlvfs.dll" ?! where is it?!
Download from here : https://bitbucket.org/dmilligan/mlvfs/downloads
and register with (in command window) : pfm register mlvfs.dll
@vertigopix thank you
how am i supposed to import in premiere? when i import the mounted MLV folder it says "File Import Failure - Unsupported format or damaged file." what am i doing wrong?
If you are using windows 8 it seems that is a problem. Win7 imports those files without any problems, for win8 you have to convert dngs to cdngs. And remember that to import you have to select only the first *000000*.dng from the folder, not the entire folder. To import many sequences i make a search for 000000 named files, than select all of them and drag and drop to premiere. But not in win8. I think it is probably because pismo doesnt fully support win8. In win8 i am using raw2cdng to convert MLVs first.
Quotefor win8 you have to convert dngs to cdngs
MLVFS already gives you cdngs.
Ali Oliya, just checking: are you using Premiere CC?
i am using the newest premiere cc on two computers: with win7 and win8. On win7 everything goes like a charm, on win8 i cannot import directly. Maybe it is not a matter of cdngs or dngs, i dont know, the fact is that mlvfs behaves differently on those systems.
@ Frank7D
its Adobe.Premiere.Pro.CC.8.0.0.169 2014 in windows 8 (i hate win8!) .
ps. i can import other cDNGs converted with MLRV and raw2cdng easily.
@ Kgv7
are you able to import mounted MLV folder directly into Premiere in win 7 ?
oops! just noticed i should use "Mount" option instead "Quick Mount" ! and then add a map drive... the problem solved! pardon me...thanks!
and here encountering another problem! it stops mapping the drive as the letters are limited to A-Z !! i can only mount 32 MLVs! what should i do now?!
Quote from: kgv5 on June 11, 2015, 12:13:36 AM
i am using the newest premiere cc on two computers: with win7 and win8. On win7 everything goes like a charm, on win8 i cannot import directly. Maybe it is not a matter of cdngs or dngs, i dont know, the fact is that mlvfs behaves differently on those systems.
I think my problem with win 8 is solved !!!
In fact it wasn't matter of the windows at all - i have bought my computer recently so i have just installed the newest Pismo File Mount Audit Package - build 177. It seemst there were some serious changes recently, i have checked this on my older desktop on which i didnt have any problems with MLVFS - it turned out that i have build 171 installed.
With older build 171 everything works ok even on windows 8. It is really GREAT! :) The biggest time saver of all times - MLVFS - is now fully functional on my new laptop :)
IMPORTANT: When you click the link on the first page of the MLVFS main topic - it will now direct you to the newest 177 build which doesn't work for us.
Hello! Can`t download MLV WebDAV Server, can someone post a link? Working with magiclantern files is new for me, but this looks promising! So please post a link, thanks.
Ossi
Reply #107
@Walter Schulz : I think he was refering to the WebDav solution, not the PISMO one.
I too am looking for the Webdav executables : on a previous windows build I had been unable to make it work and wanted to give it another go on a fresh windows install.
the Pismo solution works auite well, but having to mount each MLV file is a little cumbersome when you have dozens of files...
Thanks
TheJuice,
You might already know this, but (when using pismo) you can select all files at once and right-click and choose "quick mount."
It takes a little while for them to finish depending on how many you have.
I didn't know thanks, I thought you really had to go one by one :-p
Exist a new version of Pismo, v. 178 for download
http://www.pismotechnic.com/download/
BSOD in Windows 10 :)
I installed v. 180 of Pismo. Also downloaded MLVFS.dll I am not clear on how to "register" the MLV formatter DLL in the Pismo file mount package. Is there a register function buried somewhere?
http://pismotec.com/download/pfmap-180-readme.txt
Does any of the new pismo versions work with mlvfs?
QuoteDoes any of the new pismo versions work with mlvfs?
I'm not sure about that. I'm using 171.
QuoteI am not clear on how to "register" the MLV formatter DLL in the Pismo file mount package. Is there a register function buried somewhere?
What worked for me was:
1. Renamed the "mlvfs.dll" file (if necessary) to add the ".dll" on the end.
2. Copied the file to my Windows folder.
3. Left-clicked somewhere in the Windows folder.
4. Held down the shift key while right-clicking, and chose "Open Command Window Here."
5. Typed the command per ayshih (see below).
pfm register mlvfs.dllHere's the thread where this is discussed:
http://www.magiclantern.fm/forum/index.php?topic=13152.100 (http://www.magiclantern.fm/forum/index.php?topic=13152.100)
Hello everybody!
I personally tried Pismo both version 1.71 and 1.80.
1.80 doesn't work for me with AE.
1.71, does work for me both with PP and AE.
With 1.71, once i mount a MLV folder (no matter if "Quick Mount" or "Mount..."), Premiere Pro CC works flawlessly, while After Effects CC gives me the following error: "the file format module could not parse the file (45::35).
However, after 10-20 seconds during which i get that error multiple times, AE works smoothly anyway
Am sharing this experience for it might help others :)
Thank you all for your amazing work
Quote from: arrinkiiii on July 13, 2015, 02:12:29 PM
Exist a new version of Pismo, v. 178 for download
http://www.pismotechnic.com/download/
I can't open the site; page can't be displayed (it turns blank).
Any direct link to download the v.178?
I've installed the files pfm-178-win-exe and mlvf.dll and put them in one and the same folder. From the thread I learned that the v.1.7.8 is more stable for my win 7.
Might be a stupid question, but how exactly do I carry out the following step:
QuoteThen register the MLV formatter DLL:
Code: [Select]
pfm register mlvfs.dll
Unlike the FUSE approach on the other platforms, you mount each MLV file individually: right-click on an MLV file and select "Quick Mount".
If you wish, you can build the MLV formatter DLL yourself by installing the Windows SDK and running nmake using the SDK command prompt in the mlvfs/win directory.
Did you try the steps in my post three up from yours?
Quote from: ibrahim on January 19, 2016, 07:35:46 PM
I've installed the files pfm-178-win-exe and mlvf.dll and put them in one and the same folder. From the thread I learned that the v.1.7.8 is more stable for my win 7.
Really , I been using 171 on all my Win7 pro PC's (3 ,2 on Laptop 1 on desktop)
Quote from: ibrahim on January 19, 2016, 07:35:46 PM
Might be a stupid question, but how exactly do I carry out the following step:
QuotePlus I show how to install MLVFS for windows including register the MLV formatter .dll
New PC Tools to replace ACR & A.E. with same or better results (Without Resolve) (http://www.magiclantern.fm/forum/index.php?topic=16422.msg159671#msg159671)
Hi,
I tried the webdav solution but when I click "map" I get the error 53 "unable to connect"
I am on windows 10 pro
Then I tried Pismo and it works fluently but I have a doubt: is the color conversion reliable? I recall @Andy600 saying that mlvfs is reliable but I don't know anything about pismo
Cheers. Carlo
Pismo is just mounting the file system.
mlvfs on mac or pc is more or less the same mac just have more features
Now I get it:
pismo is mounting the system and the mlvf.dll is "doing" the conversion
The mlvf.dll has the same settings as in fuse
Thank you for your answer ;-)
Hey, just tried to download the current version of the "MLV WebDAV Server" but the server is not reachable :/
understood nothing. How to work on Windows 10 ?
Last time I had this 'error compiling movie' issue I noticed that no matter what, the effected clip always stopped rendering at exactly the same spot around 85% and then I'd get that stupid warning and it stop rendering. I clipped off about 15% of the end of the clip (guessed it) and tried rendering again and it worked! Luckily I didn't need the last bit of the clip. Just an FYI.
I use mlvfs.dll with register for Windows, everything work really nice but I can't delete the dng ? How to do ?
I followed tuto from reddeercity :
https://www.youtube.com/watch?v=hidN3C1B4xk
Edit :
I you want to delete the file when "quick mount". You have to right click "unmount" then delete the file.
Hello Magic Lantern Community,
Yesterday I searched on the forum for hours and tried multiple things to get MLVFS to work on my new PC. The operating system is Windows 10. I would like to generate dngs quickly to transcode in AE to a friendly codec. I tried using MLVProducer, but couldn't figure out how to just get dngs out of the application, and I think MLVFS might be faster. So today I deleted the installations I tried for MLVFS and am starting fresh. I am also new with Windows, coming from Mac. Is there any way someone could walk me through getting MLVFS to work on pc in Windows 10? I would really appreciate any help since I'm really lost at this point on how to get it to work. Thank you.
- Paul
Same question... is MLVFS working on Windows 10 or only up to windows 8?
I can confirm that MLVFS is working on windows 10.
I took the files in this thread but cannot remeber which ones exactly :s