Author Topic: RAW Video Post processing (raw2dng) [Mac/Win/Linux]  (Read 632899 times)

scrax

  • Contributor
  • Hero Member
  • *****
  • Posts: 1543
  • Code monkey
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #125 on: May 19, 2013, 03:16:09 PM »
That worked beautifull Scrax :)!
How about drag an drop the files all at once, would it be possible or is that asking too much right now?
Thanks a lot, both for the video and the updated script.
//D

I've made a topic for the app gui development so I can update it without asking each time to update the first topic to the admin here, let's all discuss all those thing here: http://www.magiclantern.fm/forum/index.php?topic=5508.0
I'm using ML2.3 for photography with:
EOS 600DML | EOS 400Dplus | EOS 5D MLbeta5- EF 100mm f/2.8 USM Macro  - EF-S 17-85mm f4-5.6 IS USM - EF 70-200mm f/4 L USM - 580EXII - OsX, PS, LR, RawTherapee, LightZone -no video experience-

ZUPPORT

  • New to the forum
  • *
  • Posts: 8
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #126 on: May 19, 2013, 04:01:58 PM »
My camera raw version 8.1 (CS6 plugin) don´t open the .dng files !
8.1 is the newest ?! isn't it ?? i dont find a newer update....

paramon

  • New to the forum
  • *
  • Posts: 9
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #127 on: May 19, 2013, 05:23:56 PM »
i am on 7.0 CS6, it works OK

sicetime

  • Freshman
  • **
  • Posts: 53
  • 5D III
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #128 on: May 19, 2013, 06:29:29 PM »
On windows I set open with raw2dng.exe.. files end up in the folder the raw file is in.

WORKED PERFECTLY.. THANK YOU!

budafilms

  • Hero Member
  • *****
  • Posts: 711
  • 5D Mark a1ex
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #129 on: May 19, 2013, 06:32:21 PM »
An easy to follow mac-tutorial focusing on fast conversion to AppleProRes422HQ and a bunch of other stuff like creating xmp-templates, setting upp after effects, premiere pro.



Thanks!
//D
Final Cut X, when import tiff files and put in the timeline, you can do a compound clips, and save the half of space!

Stedda

  • Hero Member
  • *****
  • Posts: 504
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #130 on: May 19, 2013, 06:54:45 PM »
My camera raw version 8.1 (CS6 plugin) don´t open the .dng files !
8.1 is the newest ?! isn't it ?? i dont find a newer update....

8.1 Beta works just fine for me...
5D Mark III -- 7D   SOLD -- EOS M 22mm 18-55mm STM -- Fuji X-T1 18-55 F2.8-F4 & 35 F1.4
Canon Glass   100L F2.8 IS -- 70-200L F4 -- 135L F2 -- 85 F1.8 -- 17-40L --  40 F2.8 -- 35 F2 IS  Sigma Glass  120-300 F2.8 OS -- 50 F1.4 -- 85 F1.4  Tamron Glass   24-70 2.8 VC   600EX-RT X3

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7237
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #131 on: May 19, 2013, 08:44:47 PM »
Final Cut X, when import tiff files and put in the timeline, you can do a compound clips, and save the half of space!

Sounds nice, a little like working with nesting i premiere pro? I prefer getting straight to PrRes422 though...

eoshq

  • New to the forum
  • *
  • Posts: 28
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #132 on: May 19, 2013, 09:31:16 PM »
Would it be possible for raw2dng.exe to somehow add the camera model to the dng file as it is created, so that we can use Adobe and custom camera profiles for the various camera models?

As it stands, the raw profile is shown as embedded and cannot be changed. It would be helpful to be able to use Adobe profiles as well as VSCO and my own custom profiles with raw video just like we can with raw stills for the 5D3.

I am aware the colors may be different, and so maybe the 5D3 raw still profiles will not be optimized for raw video, but even just having the ability to create your own profile with a color checker passport and use them with raw video would be a big plus.

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7237
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #133 on: May 19, 2013, 09:33:59 PM »
Scrax just compiled a new script that allows for dropping a whole folder on the app. Batch-converting that is. Sweet!
Latest builds in here http://www.magiclantern.fm/forum/index.php?topic=5508.0

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #134 on: May 19, 2013, 09:34:10 PM »
Yea, I like the 8.1 beta.. its working just fine.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #135 on: May 19, 2013, 10:08:27 PM »
The DNG's will open in Resolve and play as a single clip but they're not interpreted correctly.

Does this one open in DaVinci Resolve?

(I couldn't install it)

Andy600

  • Moderator
  • Hero Member
  • *****
  • Posts: 1863
  • Have you tried turning it off and on again?
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #136 on: May 19, 2013, 10:12:54 PM »
Nope, not here. It doesn't appear in the library
Colorist working with Davinci Resolve, Baselight, Nuke, After Effects & Premier Pro. Occasional Sunday afternoon DOP. Developer of Cinelog-C Colorspace Management and LUTs - www.cinelogdcp.com

CaptainHook

  • Freshman
  • **
  • Posts: 52
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #137 on: May 20, 2013, 12:03:09 AM »
Does this one open in DaVinci Resolve?

(I couldn't install it)

No, it still has some issues. Putting it through Adobe DNG convertor does allow Resolve to see it though, but with same problems before of no RAW controls like wb/tint/exposure having an effect on the image.

Here's the info from dng_validate for your file above:

http://f.cl.ly/items/2p231l3u1S1r1q3r1M25/ml.txt

This is the file after running it through Adobe DNG convertor (its added preview image, changed bits per sample, etc etc):

http://f.cl.ly/items/0w1l2s451R1H0c1V130E/adobe.txt

Here's a DNG frame from the BMCC for comparison:

http://f.cl.ly/items/362k3x1o471V2p3t2o3T/bmcc.txt

We still have these warnings on your DNG also:

*** Warning: The ExposureTime is <= 0 ***
*** Warning: Too little padding on left edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on top edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on right edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on bottom edge of CFA image (possible interpolation artifacts) ***

Hope that helps. :)

tin2tin

  • Member
  • ***
  • Posts: 158
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #138 on: May 20, 2013, 12:25:22 AM »
Would it be possible to add specification of the full path for the import file in "" and a full destination directory in "" to raw2dng?

eoshq

  • New to the forum
  • *
  • Posts: 28
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #139 on: May 20, 2013, 01:29:34 AM »
Does this one open in DaVinci Resolve?

(I couldn't install it)

Awesome... I can use a camera profile with this DNG, because it is recognized by Adobe as being from a 5D3. Thank you.  :)

squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #140 on: May 20, 2013, 02:03:46 AM »
Would it be possible for raw2dng.exe to somehow add the camera model to the dng file as it is created, so that we can use Adobe and custom camera profiles for the various camera models?

As it stands, the raw profile is shown as embedded and cannot be changed. It would be helpful to be able to use Adobe profiles as well as VSCO and my own custom profiles with raw video just like we can with raw stills for the 5D3.

I am aware the colors may be different, and so maybe the 5D3 raw still profiles will not be optimized for raw video, but even just having the ability to create your own profile with a color checker passport and use them with raw video would be a big plus.

You can create your own profiles in adobe camera raw. I'm working on a log sLUT now, when I'm happy with it I'll share it. I hear visioncolor are creating one and I expect others will share theirs too.

peoplemerge

  • Freshman
  • **
  • Posts: 50
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #141 on: May 20, 2013, 03:45:26 AM »
I also had the problem with >2G files.  These came from a 5D2 from source built yesterday.

I started by hacking the file with tail -c <various sizes>, same errors.

Next I tried calculating the # frames assuming frame sizes would be fixed from file to file and hardcoding raw2dng.c.  Photoshop couldn't open the resulting files saying the raw format wasn't supported.  No big surprise.

Finally (I'm on a mac) I installed wine and tried fatpig's BATCHelor.  Success!

I'm convinced there's an number size or endianness issue hidden there.  I'll try hacking it later tonight if I have time.

peoplemerge

  • Freshman
  • **
  • Posts: 50
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #142 on: May 20, 2013, 04:00:02 AM »
I may have spoken to soon...
2 of the 3 files that couldn't be consumed by the mac version worked with fatpig.
The last one (also the largest at 3,099,096,000 bytes) still couldn't be read.

I wonder if on some of these it had to do with the way I was stopping the recording.  On my camera, when the raw video stops, it shows video is continuing to record.  I might have shut off the camera this time.

tin2tin

  • Member
  • ***
  • Posts: 158
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #143 on: May 20, 2013, 10:23:11 AM »
Would it be possible to add specification of the full path for the import file in "" and a full destination directory in "" to raw2dng?
I might add that if this was added then EyeFrame could be used as a Windows(& Linux under WINE) GUI for batch processing RAW files to dng by adding a two lines preset file.

BTW. ffmbc only appears to be able to open the first frame of a RAW video file. Hopefully this could be fixed at some point.

olik

  • Freshman
  • **
  • Posts: 81
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #144 on: May 20, 2013, 12:18:23 PM »
Has anyone tired with the new build from today to open the DNGs in Davinci resolve?

fatpig

  • Member
  • ***
  • Posts: 163
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #145 on: May 20, 2013, 07:08:04 PM »
Batch RAW to DNG for Windows is here!

I wrote this little tool for you.
It's called RAW2DNG BATCHelor 1.0
I would be happy if you like it.
It automates the conversion and generates a nice thumbnail. :)
dowload here:

http://fatpigtures.com/software/

ZUPPORT

  • New to the forum
  • *
  • Posts: 8
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #146 on: May 21, 2013, 08:12:23 AM »
still can`t open .dng files !
mac osx 10.7 + cameraraw 8.1 (newest update)
will not open the DNG´S !

any ideas ??!

• in Photoshop CS6
https://dl.dropboxusercontent.com/u/33878668/camerarawupdate.jpg

• the Adobe DNG converter
https://dl.dropboxusercontent.com/u/33878668/dng.jpg

• & After effects !
https://dl.dropboxusercontent.com/u/33878668/ae.jpg

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #147 on: May 21, 2013, 09:12:25 AM »
raw2dng update for 4GB files, from rodobot: http://www.magiclantern.fm/forum/index.php?topic=5247.msg38080#msg38080

Can you check if it's working on Windows? (see first post for download)

platu

  • Member
  • ***
  • Posts: 101
  • 5D3, 60D
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #148 on: May 21, 2013, 09:58:55 AM »
raw2dng update for 4GB files, from rodobot: http://www.magiclantern.fm/forum/index.php?topic=5247.msg38080#msg38080

Can you check if it's working on Windows? (see first post for download)

Working on Windows...  just tried it on a 6gb file.

scrax

  • Contributor
  • Hero Member
  • *****
  • Posts: 1543
  • Code monkey
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #149 on: May 21, 2013, 10:00:44 AM »
still can`t open .dng files !
mac osx 10.7 + cameraraw 8.1 (newest update)
will not open the DNG´S !

any ideas ??!

• in Photoshop CS6
https://dl.dropboxusercontent.com/u/33878668/camerarawupdate.jpg

• the Adobe DNG converter
https://dl.dropboxusercontent.com/u/33878668/dng.jpg

• & After effects !
https://dl.dropboxusercontent.com/u/33878668/ae.jpg

Is not camera raw, is something that got changed in last code, having that problem after updating sources.

Before dng files were without preview and Photoshop opened them right, now they seem to have a wrong preview and can't be opened in Photoshop

Error is:
Quote
Could not complete your request because an unexpected end-of-file was encountered.
I'm using ML2.3 for photography with:
EOS 600DML | EOS 400Dplus | EOS 5D MLbeta5- EF 100mm f/2.8 USM Macro  - EF-S 17-85mm f4-5.6 IS USM - EF 70-200mm f/4 L USM - 580EXII - OsX, PS, LR, RawTherapee, LightZone -no video experience-