Author Topic: RAW Video Post processing (raw2dng) [Mac/Win/Linux]  (Read 612383 times)

Northshoots

  • Just arrived
  • *
  • Posts: 1
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #275 on: July 23, 2013, 11:19:14 AM »
I got back today from a forest trip where I filmed more than 85 raw sequences. So converting them manually become not an option. I wrote a script for mass conversion of the files. Feel free to give suggestions for improvement or hack your self http://shieldroute.blogspot.se/2013/07/quick-and-dirty-multiply-raw-file.html

My workflow was:
move full card to -> date\1\
                           -> date\2\
                           -> date\3\
 etc
so the scripts checks only subfolders for a given folder. Then it enters there creates new folder with a name same as file name and converts it using raw2dng.
Resulting structure
date\1\ML_001.RAW
date\1\ML_001\000000.dng
date\1\ML_001\000001.dng
.................
date\1\ML_001\00xxxxx.dng
date\1\ML_002.RAW
date\1\ML_002\000000.dng
date\1\ML_002\000001.dng
.................
date\1\ML_002\00xxxxx.dng

hope someone will find it useful and will be less frustrated coming home with may sequences. There is no fall back safely implemented, but I will added if some one needs it.

Cheers

egc

  • New to the forum
  • *
  • Posts: 11
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #276 on: July 23, 2013, 01:33:54 PM »
Linux shell script for conversion to mjpeg: raw2avi.sh

Hallo!

First of all: THANKS a lot for this script!!

As raw2dng does not exist for Linux (at least i could not find it) i think it is better to tell people they can install wine and change the script in line 8 from
Code: [Select]
${DIR}/raw2dng $1to
Code: [Select]
wine ${DIR}/raw2dng $1
That works fine and people don't have to waist days trying to compile raw2dng or changing to Windows just to do the raw2dng step.

Thanks!

Best regards
egc

yanone

  • New to the forum
  • *
  • Posts: 13
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #277 on: July 29, 2013, 06:42:01 PM »
One question about DNGs that I haven't seen discussed anywhere in the forum so far:

Processing them with ACR in AE produces inconsistent results when the white and black points (=lighting) change between frames. The brightness/darkness recovery sliders (the most important in my opinion) seem to respond to a relative black and white point per image.

Do you see a way to synchronize the black and white points (whatever that even means, I'm no expert) across images? Maybe by measuring the lightest and darkest pixel across all images of a scene and then changing certain settings in the files accordingly? Maybe even by drawing a black and a white pixel into the files as a punky hack?

I'm not asking the software authors here to implement this, only about implementability. I might like to try myself.
Or is there a much easier way I'm not aware of? I'm asking about ACR because the grading in Resolve doesn't work for me. Plus ACR has many abilities that I'm familiar with from photography like abberation reduction and stuff.

coopybook

  • New to the forum
  • *
  • Posts: 4
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #278 on: August 04, 2013, 03:13:13 AM »
I want to start by giving a huge thanks to everyone involved with Magic Lantern and this forum. It's impressing to see the tool progress.

I shot some footage that looks like it's sped up after post-processing it. It gives the impression that it was recorded in another, lower frame rate than 25, when looking at it after it's been post-processed. I did not have FPS override to ON in magic lantern, could this have affected it?

I used the june 3rd-version with 5D MKIII. Camera settings i Canons menu set to PAL and video set to 1080p 25fps ALL-I.

In post when converting to dng's with raw2dng.app, it says that it was shot with 25 fps. That's problably just camera metadata though? I tried the workflow with both After Effects and using Quicktime 7 via Photoshop. When importing the image sequence inside After Effects it came in as 30 fps. I interpreted the image sequence from 30 to 25 and created a comp from that. That's when I get that sped up look. Anyone else experienced this problem?


I have exactly the same setup/camera as you have and the same problem, but new version of ML 10 June. I have exactly the same issue. I used the raw2dng.exe - 10 june.

I have the same problem on Canon 60D. Does anyone found solution?
I have tried all possible varieties, changes frame rates, NTSC,PAL, resolution, - results always the same.
Becouse of this problem i can't get together video and external recorded sound. That is realy bad!
If anyone have any ideas how to fix it, please share!!!
Thank You!

budafilms

  • Hero Member
  • *****
  • Posts: 711
  • 5D Mark a1ex
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #279 on: August 04, 2013, 03:39:44 AM »
Exist a way to get, from RAW2DNG or MAGIC Raw,  a way to join raw with .WAV?

Anybody knows a way to do this faster?

coopybook

  • New to the forum
  • *
  • Posts: 4
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #280 on: August 10, 2013, 01:05:04 PM »
I have the same problem on Canon 60D. Does anyone found solution?
I have tried all possible varieties, changes frame rates, NTSC,PAL, resolution, - results always the same.
Becouse of this problem i can't get together video and external recorded sound. That is realy bad!
If anyone have any ideas how to fix it, please share!!!
Thank You!

Regarding the 24 fps problem:

Hi guys I had the same problem with my 60D raw videos but I found the fix:

First: make sure you do have framerate override on and set to 23.98 or 24fps just to eliminate any in-camera issues.

Second: It took me a while to realize that the problem was with a default setting in after effects. Unless you tell it not to, AE will interpret all imported files as 30fps (which causes the speed up to 24fps material). To fix, right click on your footage in the project bin and choose: Interpret footage > main. Then input the correct framerate depending on what you sent your override at. VOILA

Here is a visual example that I found:
the setting:
http://i.stack.imgur.com/JehOz.png

the dialog window:
http://i.stack.imgur.com/z7Yy0.png

tool

  • New to the forum
  • *
  • Posts: 25
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #281 on: August 12, 2013, 12:38:12 AM »
Moved__

Fringuello

  • Freshman
  • **
  • Posts: 79
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #282 on: August 13, 2013, 02:04:09 AM »
su windows 8 non funziona? :-[
Italy - canon 7D

manniac

  • New to the forum
  • *
  • Posts: 18
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #283 on: August 17, 2013, 10:42:54 PM »
extracting dngs from the raw (5DIII) is quite slow on my machine (win7 64bit). for some reason the first 100 pictures or so are quite fast and everything after is slow. at the same time my 6 core cpu doesnt seem to be overly occupied..
Does anyone have tipps how to improve performance on raw2dng.exe?

Fringuello

  • Freshman
  • **
  • Posts: 79
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #284 on: August 22, 2013, 04:35:36 PM »
scusate perchè su imac non funziona  :-[
Italy - canon 7D

ilguercio

  • Hero Member
  • *****
  • Posts: 845
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #285 on: August 22, 2013, 04:43:55 PM »
Again, this is an English board.
Everybody needs to understand you.
Capisci?
Canon EOS 6D, 60D, 50D.
Sigma 70-200 EX OS HSM, Sigma 70-200 Apo EX HSM, Samyang 14 2.8, Samyang 35 1.4, Samyang 85 1.4.
Proud supporter of Magic Lantern.

Fringuello

  • Freshman
  • **
  • Posts: 79
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #286 on: August 23, 2013, 12:54:25 AM »
ok, I have a mac dragging the raw file on raw2dng nothing happens.
thanks
Italy - canon 7D

David J. Fulde

  • New to the forum
  • *
  • Posts: 24
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #287 on: August 25, 2013, 09:28:34 PM »
Will the GUI work with DualISO?

pavelpp

  • Freshman
  • **
  • Posts: 92
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #288 on: August 29, 2013, 10:57:14 AM »
I keep getting a segmentation fault, when trying to convert a raw video with raw2dng executable on OS X 10.7.5.

Code: [Select]
Resolution  : 1728 x 736
Frames      : 54
Frame size  : 2228224 bytes
Frame skip  : 1
FPS         : 19.998
Processing frame 1 of 54...Segmentation fault: 11

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #289 on: August 29, 2013, 11:01:26 AM »
Read this http://www.chiark.greenend.org.uk/~sgtatham/bugs.html

and upload the video file.

alexp

  • New to the forum
  • *
  • Posts: 30
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #290 on: August 30, 2013, 02:57:55 AM »
Hey guys, I have a workflow question. After editing reference files in FCP7, how do you replace them with image sequences? Is that even possible? Until now I've been using QT7 to export image sequences into Pro Res, which takes a lot of time doing one by one. Trying to simplify this process. Please share...


Midphase

  • Hero Member
  • *****
  • Posts: 712
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #291 on: August 31, 2013, 08:39:14 PM »
Hey guys, I have a workflow question. After editing reference files in FCP7, how do you replace them with image sequences? Is that even possible? Until now I've been using QT7 to export image sequences into Pro Res, which takes a lot of time doing one by one. Trying to simplify this process. Please share...

On the Mac, I think the workflow which still makes the most sense is to use something like Resolve to batch output to ProRes for editing. I think ProRes is fine for finishing too actually, if you export at ProRes 422HQ using a LOG type of look, you'll retain pretty much most of the visual information that you need. Most people who shoot on the ARRI Alexa shoot in ProRes and not raw and they seem to be just fine with the quality output, so once you process the image sequences into ProRes, I don't know if you need to go back to the DNG format for finishing.

But yeah, use Resolve for batch creating the ProRes files...it's a whole lot faster.

alexp

  • New to the forum
  • *
  • Posts: 30
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #292 on: August 31, 2013, 11:15:13 PM »
On the Mac, I think the workflow which still makes the most sense is to use something like Resolve to batch output to ProRes for editing. I think ProRes is fine for finishing too actually, if you export at ProRes 422HQ using a LOG type of look, you'll retain pretty much most of the visual information that you need. Most people who shoot on the ARRI Alexa shoot in ProRes and not raw and they seem to be just fine with the quality output, so once you process the image sequences into ProRes, I don't know if you need to go back to the DNG format for finishing.

But yeah, use Resolve for batch creating the ProRes files...it's a whole lot faster.

Thanks Midphase. Will the free version of DaVinci Resolve Lite batch output files to Pro Res?


dickson

  • New to the forum
  • *
  • Posts: 17
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #293 on: September 02, 2013, 03:36:51 AM »
Could the opening post include also commandline howto (taken from http://www.magiclantern.fm/forum/index.php?topic=5533.msg37819#msg37819 ):

Joining files
WIN
    Start dialog: cmd
    1. cd C:\Users\my_destination_folder
    2. copy /B xyz.RAW+xyz.R00+xyz.R01 xyz.RAW

OSX/LINUX
    Start Terminal
    1. cd /Volumes/my_destination_folder
    2. cat xyz.RAW xyz.R00 xyz.R01 > xyz.RAW

    Tips: cmd and Terminal support drag & drop => Don't need to type!

I do this (in Windows) on one raw and one r00 file, hence copy /B xyz.RAW+xyz.R00 xyz.RAW - that's right, isn't it? And I get one RAW file, a lot smaller than the originals, and it won't open in raw2dng. Any ideas?

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #294 on: September 02, 2013, 02:50:14 PM »
I do this (in Windows) on one raw and one r00 file, hence copy /B xyz.RAW+xyz.R00 xyz.RAW - that's right, isn't it? And I get one RAW file, a lot smaller than the originals, and it won't open in raw2dng. Any ideas?

Read:
RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

Your format is wrong
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

dickson

  • New to the forum
  • *
  • Posts: 17
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #295 on: September 02, 2013, 10:30:36 PM »
Read:
RAW Video: PostProcessing -- Beginners Guide --
http://www.magiclantern.fm/forum/index.php?topic=5654.0

Your format is wrong

Thanks! I changed the formatting to exfat, but the 5d mkii doesn't seem to recognize it.

I'll change back and try the file-renaming.

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #296 on: September 02, 2013, 10:50:52 PM »
Thanks! I changed the formatting to exfat, but the 5d mkii doesn't seem to recognize it.

I'll change back and try the file-renaming.

No, I was not clear.  Your file naming format is wrong!

Try this:

copy/b file1.raw+file2.raw+.... filenew.raw

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

dickson

  • New to the forum
  • *
  • Posts: 17
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #297 on: September 02, 2013, 11:36:05 PM »
No, I was not clear.  Your file naming format is wrong!

Try this:

copy/b file1.raw+file2.raw+.... filenew.raw

I changed the file names as you suggested, but I'm getting the same thing - a new file much smaller than the originals, and that won't open. (The original r00 will open, but the dngs are completely garbled.)

Update: figured it out with FSJ, thanks for your help!

ifleeter

  • New to the forum
  • *
  • Posts: 19
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #298 on: September 10, 2013, 09:02:54 PM »
Not sure where to post this. I have converted my raw files with the raw2dng converter and the first frame is great but then all the rest have this Pink banding.


RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: RAW Video Post processing [Mac/Win/Linux]
« Reply #299 on: September 10, 2013, 09:55:38 PM »
Not sure where to post this. I have converted my raw files with the raw2dng converter and the first frame is great but then all the rest have this Pink banding.

http://www.catb.org/~esr/faqs/smart-questions.html
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X