Messages

I am also making progress in dealing with focus pixels. Please see http://www.magiclantern.fm/forum/index.php?topic=16054.msg180682#msg180682. Would be great if anybody can post recordings so that I can map out the focus pixels for different cameras. EOS M I already have.

I am working on a method of removing focus pixels myself and I thought I post the pixel map for the Canon EOS M here, just in case there is anybody who can make use of it with the usual tools. I did not try myself. I have a method of extracting the focus pixel map from actual MLV files. All I need is a short recording with the highest possible resolution in fullframe and crop mode. If anybody can provide that for other cameras, I can extract the map and most it here.

https://www.dropbox.com/s/sdqopv87n6w9us6/EOS_M_FocusPixels.zip?dl=0

If you make a recording, remove the lens and point the camera to the sky. Then expose the image so that you have 98% white on screen. The white should not clip.

@cpc @budafilms

Unfortunately I can't fix problems in the RAW module myself, since I am using Apple's RAW engine that I have no control over. I sent a bug report to Apple however. I tried changing the white level and clamping raw values to lower levels, but that only makes the problem worse. I found this post (http://www.darktable.org/2016/10/raw-overexposed/) and developed a custom Core Image filter that does the trick. From the raw data, I am now creating another raw image that only contains luminance data for the highlights above 0.9 (normalized). I then take this image as a mask and desaturate the highlights.

Before: https://www.dropbox.com/s/fmybr0szer04geg/magenta_before.png?dl=0
After: https://www.dropbox.com/s/ayqp3vsq510nxz3/magenta_after.png?dl=0

This gives a descent result until Apple fixes its raw engine.

@cpc

Looks like the white level is too high, you should be able to remedy this by pulling it down.

What do you exactly mean with "white level"? Can you give an example?

@budafilms The problem with the image is that there is insufficient information in the color channels. Red and blue is clipped and only green has some information left. When you adjust the whitebalance, the highlights are now being moved to magenta. I think there is a filter for highlight reconstruction needed. Looking into that.

Where is this app to try?

Current build here:
https://rink.hockeyapp.net/apps/3ed6ecf60e684239a6aba3d407cf3935

@dfort

I am all for open source. The problem with open sourcing end-user software is that some people just take the code, compile it, put it on the App Store and sell it for a couple of bucks. There are lots and lots of scams like that on the App Store.

Just an idea but would it be possible to create a plugin or something that will allow MLV files to be opened directly in editing apps like Final Cut Pro, Premiere, Resolve -- maybe even After Effects?

That might be possible, but than I am opening myself up to even more licensing issues. Will look into that though.

@reddeercity

Only Runs on OS X 10.12  & up ?

I am on it. Will port it back to Yosemite. Shouldn't be a problem.

@frenchps49

how do you remove clips from the left side of the app once they have been converted

You can select the file and then choose "Delete" from the "Edit" menu. This action can also be undone afterwards. I'll add the "Del" as a hot key.

a) is it open source?

No, not at the moment.

b) does it use any of ML's code?

No, it doesn't.

c) do you include header files like mlv.h?

Yes, I do. Do you want me to remove that file? Since it only includes the structs, I figured that this is not a problem. But, if you guys insist, I'd remove the file and do the parsing differently.

Here are some evidence, that I am not simply using the GPL code:

- My app is 64bit, Magic Lantern is 32bit only
- My app does not use any of the GPL raw processing, it uses Apple's CIRawFilter and a bunch of Core Image filters to enhance the image.

Only 14bit raw works for me so far – 12bit looks 2 stops under and 10bit looks very dark with pink highlights (5D3)

One more question. How do I set 12bit and 10bit in camera settings? I also have a 5d3. Can't find the settings. Do you maybe have some sample files?

Sorry to ask, but any chance you´ll be able to make it available for OSX El Capitan (10.11.6)? I can´t upgrade any of my computers to Sierra due to software and plugins I use for work that isn´t compatible with Sierra yet, and would love to try out this new seemingly awesome conversion software for Magic Lantern you´ve created

Should be possible.

Can you add a hotkey for removing files from the left pane (del)?

Yes, no problem.

Only 14bit raw works for me so far – 12bit looks 2 stops under and 10bit looks very dark with pink highlights (5D3)

OK, I'll check it out.

I have some suggestions: [edit:] toggle grade on/off, reset grade, zooming in preview window (to check noise, sharpness)

You can reset any slider to the default value by double clicking in it. For all the other stuff, I am on it.

There was a bug with exporting files without audio. Has been fixed. Please update using the menu item "Check for Updates". I am also getting crash logs during reading of mlv files from disk. Can anybody supply sample files that show this behaviour? Send the link via PM. Thank you.

I'm on eos m. clicked the plus sign added a file. only see black screen no preview of the mlv file..tried to export it without seeing it and it crashed.

Can you provide a sample MLV file?

OK, I finished up the first Alpha build. You can download it here: http://bit.ly/2kHwn9V

- Open the app and click on the + button in the top left corner of the window
- Add 1 or more MLV files or select a folder
- Select the files in the left sidebar
- Editing the image parameters in the right sidebar
- Change the video possible below the image preview
- Export with the export button in the top right corner of the window

That's it. Happy testing. Let me know what you think.

There's also a new screenshot:

Could you post a short example in ProRes 4444 XQ? That's what the raw video users want to work with.

I did a little digging into the 4444 XQ situation. It is very bizarre. There 2 media architectures: QuickTime and AVFoundation. QT is 32-bit only. I am using AVFoundation. The ProRes AVFoundation plugin sits in /System/Library/Video/AppleProResCodec.bundle. It contains support for 4444XQ, however only decoding. When you get FinalCut or Compressor, you can extract a plugin component called "AppleProResCodecEmbedded.component", which contains 4444XQ encoding. This is the 32-bit only QT Plugin. It is used by FinalCut and Compressor via the AVFoundation plugin "AppleCMQTAdapterCodec.bundle". You can copy the "AppleProResCodecEmbedded.component" into /Library/QuickTime to enable 4444XQ encoding in old apps like "QuickTime Player 7". Unfortunately I could not get the "AppleCMQTAdapterCodec.bundle" to work. No hack I know worked. I could go ahead and implement a 32bit process that encodes 16bit RGB image, but this seems to be a lot of work for something that Apple might enable in the near future.

Anyway, I can only offer normal 4444 at the moment. Here are two sample clips (1.3 GB each):
https://www.dropbox.com/s/fa0gej9yvvs64ry/M14-0954.mov?dl=0
https://www.dropbox.com/s/08jsc80n1qnpbus/M14-1031.mov?dl=0

+10 but also keep in mind that this actual Log is a paid product commercially and would require certain users to use this -- reach out to @Andy600 and maybe he'll give you hints?

I checked it out. Thanks for the hint. Looks very good. It shouldn't be a problem to support LUTs for color space conversion. However it seems that I can't ship the app with embedded support for it.

It was definitely worth the wait but I haven't tested it yet and wanted to ask does it export ProRes4444XQ at the very least, right?

Oh snap. This looks cool. Can it deal with sound and 10/12 bit dngs? Looking forward to a release.

OK, so the RAW is 14 bit. This image gets processed in Core Image using 64 bit float and then drawn into a ProRes4444XQ 12-Bit pixel buffer. If you choose ProRes 422, it's only 10 bit, but also fine. This is the highest quality workflow, I could come up with. I could process the image using 128 bit floats, but I really can't see any difference in the result. It just uses more memory.

plus are you also using MAC Camera Raw backend for white & black levels

Yes, I am.

Also do you plan on including with an option to use a Waveform and if possible an option to apply Logs/LUT's of our own as well within Color Space?

With Waveform, I suppose you mean the image diagram and not the audio waveform. I could do that, not planned yet though. LUTs are definitely planned. As for color spaces, currently it can convert to sRGB, Adobe RGB, Rec.709, C-Log, S-Log, S-Log2, S-Log3. Let me know what else you need and where I can find the formular.

It'll work with MLV files directly. However maybe not every feature is going to be supported first, since I am implementing everything from scratch. But standard video and audio should be fine.

This is a Mac-only app, so I am using AVFoundation's AVAssetWriter class to export ProRes. There's lots of sample code at developer.apple.com.

Hi,

I am Martin Hering, a long time Apple Developer. I recently got into filming and Magic Lantern. As a developer I was a little frustrated with the RAW processing situation on MacOS. There seems not to be an all-in-one setup-free solution that is able to develop RAW images and export to ProRes or whatever. So I decided to fill this gap. I only put in a couple of hours yet, but developing RAW and export to ProRes already works. You don't need any other tools or programs, you only need to run this app. Here's a screenshot:



And here's an example ProRes 422 export, filmed with a 5d Mark III (350 MB):
https://www.dropbox.com/s/qnh54t35o7oyc1n/M05-1847.mov?dl=0

The application uses Apple's system RAW engine and Core Image for image processing. Export is 2.8x faster than MLRawViewer. Here is what I have planned for 1.0:

- Folder based file management
- Batch processing files
- Histogram and RGB Parade
- Reference Mode (2 images side by side to match footage)
- Export to all kinds of formats

Let me know what you think and if you like to test it out. I might be able to post an alpha version in 2 weeks. Also please post your feature requests.

Cheers,
Martin