Magic Lantern Forum

Using Magic Lantern => Post-processing Workflow => HDR and Dual ISO Postprocessing => Topic started by: jerrykil on October 23, 2013, 11:06:23 PM

Title: Mac workflow app/script for dual_iso and HDR video
Post by: jerrykil on October 23, 2013, 11:06:23 PM
Hey ppls!
I make some tools for y'alls. I'll make a windows version eventually, but I don't have the time until almost next summer.

Platypus based app for batch converting dual_iso CR2 files. exiftool and dcraw are embedded. It updates with tragiclantern's nightly cr2hdr build so you stay current.
http://tl.bot-fly.com/misc/kit_cr2hdr.zip (http://tl.bot-fly.com/misc/kit_cr2hdr.zip)

this is for batch processing HDR videos. they won't play in quicktime, if you know what codec i can use for quicktime lemme know! read the readme for details
http://tl.bot-fly.com/misc/kit_hdrvideo_v.02.zip (http://tl.bot-fly.com/misc/kit_hdrvideo_v.03.zip)
EDIT: v0.03 hasn't been tested yet. let me know if the align_image_stack binary works for you.
comments? questions?

EDIT: also see http://www.magiclantern.fm/forum/index.php?topic=7139.msg59687#msg59687 for windows tools and another GUI for cr2hdr...

EDIT: Got some updates coming, just waiting for my webhost to come back online
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: blade on November 13, 2013, 09:59:42 AM
Just used it, and it worked very well.

Thanks!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: NateVolk on January 11, 2014, 08:58:55 PM
Stoked on the cr2hdr script!  Trying it now :)  Its awesome not having to try and update the latest builds!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: choupique on January 26, 2014, 08:03:55 PM
Have you had success converting  dual-isos off of a 6d. I appreciate the link!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jerrykil on February 15, 2014, 02:30:31 AM
sry, my life is on hold till the end of march. wish me luck on my board exam!!!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: cmw on March 23, 2014, 10:09:35 PM
First I want to say thanks for making this! I'm relatively new to ML and still figuring a lot of things out, so I apologize if this question has a simple answer that I'm overlooking haha.  I took a 15 second test shot using the HDR function on my t3i set at 60fps and ISOs 200 and 1600 with my shutter speed set at 1/120. When I brought the footage into my macbook pro and I followed the instructions you provided in the readme text and all seemed to work fine.  I then imported the merged .png files into premiere and once it rendered each clip played at 5 second intervals resulting in just a very long image sequence.  Is there a step in ML or the post-processing stage that I'm doing wrong? Also sorry if I haven't included enough information.  Any help is appreciated thanks!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jbggump on March 24, 2014, 03:13:15 PM
I also want to thank you for this script!  Yesterday, I took this test shot...got a lot of flickering with the dual ISO.  You can see it on the link.  Any thoughts?  Video was shot at 1/30th and 200/3200 dual iso.

As well, when I tried to do multiple videos for the batch process using kit_hdrvideo, I only got one rendered file...not a combined of all of the files I wanted rendered, but just the first one of the bunch.  The app took the time it seemed to render more, but they never showed up. 

https://www.flickr.com/photos/8843350@N07/13380767944/

I ran it through Red Giant Denoiser II thinking that might help, but no dice.  Did another test...one shot at 1/30 and one at 1/125...no dice either.

Thanks!

Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jbggump on March 27, 2014, 02:32:05 AM
Just got brand new MK III and same issue as I had above...would love to hear other results. 

One difference is that the processing took forever, much longer (3x-4x) than the footage from the MK II...both set on 1080. 
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jerrykil on April 10, 2014, 08:30:09 PM
I'm a poor man w/o a 3D to play with :(
Maybe the frame rate is the difference? What kinda machine are you processing on?
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jbggump on April 11, 2014, 03:08:00 PM
It is the frame rate I think...I am fairly new to digital video (did Beta back in the late 90s in college).  I shoot at 29.97fps and with the dual ISO it goes to 14.99fps.  I can't really wrap my head around what to do to make is smooth.  I speed the footage up anywhere from 125% to 200%, but it doesn't seem natural...could just be me though.  Do you have a suggestion?  I did a quick video to show the differences...  200% would seem logical, but it moves faster than real life (but is smooth).

Just dawned on me...do I need to be shooting at 1/60?  I am usually at 1/30...

https://vimeo.com/91710681

Also, I can't get the batch HDR to work.  It only does one file if I have multiple in the folder.

Processing on 2.7 i7 MBP.  16gb ram.

Love the program though - I can sense it will be advancing my work.  Thank you

Jed 
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Oliver on April 19, 2014, 11:05:47 AM
Example:

A Image 1 ISO 100
B Image 2 ISO 800
C Image 3 ISO 100
D Image 4 ISO 800
E Image 5 ISO 100
F Image 6 ISO 800

I think what is lacking is a software that produces not just blended images of A and B then C and D, but:

Currently the software does:

New Image 1: A+B
New Image 2: C+D
New Image 3: E+F

This halfs the framerate. What we need is:

Image 1: A+B
Image 2: B+C
Image 3: C+D
Image 4: D+E
Image 5: E+F

As you see we loose only ONE TOTAL Image per Stream, and i guess there is a better blending in between. So in result, the mentioned possibility to overlay the same video with one image shifted, seems to be the best approach, unless there is a special software, that does even more clever in between blending.

Perfect workflow I imagine would be to use Dual Iso with Raw recording, then combine by a script A+B B+C in 14 Bit a.s.o.  as new HDR images and then go on from there i.e. with Resolve.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: jerrykil on July 28, 2014, 02:56:07 AM
good ideal, i'll work on that!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Wyld Dingo on August 10, 2014, 04:57:06 AM
jerrykil, thanks for your help with this.  We're really depending on you!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: david.l.matthews on August 11, 2014, 06:19:13 PM
Hello everyone, I'm a new user of HDR video. I downloaded the "kit_hdrvideo_v.03" to process my HDR videos from this forum. The program was working perfectly until today. I continue to get this error message! Any help would be greatly appreciated.


ffmpeg version 2.0.2 Copyright (c) 2000-2013 the FFmpeg developers
  built on Oct  9 2013 10:18:52 with llvm-gcc 4.2.1 (LLVM build 2336.11.00)
  configuration: --prefix=/Volumes/Ramdisk/sw --enable-gpl --enable-pthreads --enable-version3 --enable-libspeex --enable-libvpx --disable-decoder=libvpx --enable-libmp3lame --enable-libtheora --enable-libvorbis --enable-libx264 --enable-avfilter --enable-libopencore_amrwb --enable-libopencore_amrnb --enable-filters --enable-libgsm --arch=x86_64 --enable-runtime-cpudetect
  libavutil      52. 38.100 / 52. 38.100
  libavcodec     55. 18.102 / 55. 18.102
  libavformat    55. 12.100 / 55. 12.100
  libavdevice    55.  3.100 / 55.  3.100
  libavfilter     3. 79.101 /  3. 79.101
  libswscale      2.  3.100 /  2.  3.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  3.100 / 52.  3.100
[NULL @ 0x7ff48a818600] Unable to find a suitable output format for 'HDR-ext.'
HDR-ext.: Invalid argument
logout

[Process completed]
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Marc Griffith on February 08, 2015, 03:36:58 AM
Hey jerrykil nice script.

I was just playing with hdrvideo_v.04 and found that the included version of align_image_stack would not run on my system. 10.8.5 with macports and all sorts of crap on it. :


BigAl:bin marcgriffith$ ./align_image_stack
dyld: Library not loaded: /usr/local/opt/gettext/lib/libintl.8.dylib
  Referenced from: /Users/marcgriffith/Documents/marcgriffith.net/video ideas/magic lantern/kit_hdrvideo_v.04/Frameworks/libglib-2.0.0.dylib
  Reason: image not found
Trace/BPT trap: 5
BigAl:bin marcgriffith$


I had my path setup to run hugin's align_image_stack so I just changed all the references to plain align_image_stack in the script.

Works great now.

Is this script open source ?,  I'd like to adapt it for other uses.
Title: Mac workflow app/script for dual_iso and HDR video
Post by: DeafEyeJedi on February 08, 2015, 03:54:14 AM
@Danne's latest app 'cr2hdr-r'
works quite well and is definitely worth checking out!

Thanks @jerrykil for making this possible with @Danne's app as well!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Marc Griffith on February 08, 2015, 05:12:04 AM
Quote from: DeafEyeJedi on February 08, 2015, 03:54:14 AM
@Danne's latest app 'cr2hdr-r'
works quite well and is definitely worth checking out!
http://www.magiclantern.fm/forum/index.php?topic=13512.0
Yes, that is precisely what I was looking for. Thanks.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: awax1978 on February 20, 2015, 08:19:30 PM
Hi guys

I've started the command about 2 hours ago (the original mov file is 1GB) and its still nowhere near finished. I've got a pretty decent iMac. Anyone else experiencing such long times?

Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Walter Schulz on February 20, 2015, 08:23:17 PM
"Pretty decent iMac" doesn't tell specs. Please do so.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Danne on February 21, 2015, 10:48:55 AM
1 gb of h.264 .mov will take a while. However except for photomatix this probably is the fastest way of transcoding thanks to Jerrykils multithreading workflow.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: classicbs on May 21, 2015, 11:39:20 PM
Amazing, I wish A1ex would have added add this to the description in the original thread.  Many thanks
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 08:47:34 PM
Can anyone help me. I shot some HDR video using ML on my 5D mark III, then ran it through kit_hdrvideo_v03 of which I love! And just for the record it was very fast!

The problem I have is that when it was finished processing the new clip it was very choppy. Here's a link to the clip: https://www.youtube.com/watch?v=iWjSE34JALs&feature=youtu.be

I have no idea why the clip is choppy, any help would be very very welcome!!!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Danne on August 19, 2015, 08:55:51 PM
did you shoot at 24, 25 or 30 fps? The script creates sequences which will half the fps so 48, 50 or 60 fps is advisable if you don,t want to interpolate in post.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 09:01:57 PM
I shot it at 23.98fps. Does this mean that all the footage I shot at this frame rate it ruined?
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Walter Schulz on August 19, 2015, 09:04:38 PM
You might want giving Twixtor a chance.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 09:07:21 PM
Would Twixtor solve the choppy footage or am I to late to do anything with that footage?
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Walter Schulz on August 19, 2015, 09:11:13 PM
You have to find out.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 09:23:46 PM
Cheers, I give it a go!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: DeafEyeJedi on August 19, 2015, 09:37:13 PM
Twixtor may help save the footage but it is always recommended to shoot in high fps such as 48, 50 or 60 as @Danne suggested.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 10:40:19 PM
I tried Twixtor, and it didn't work! Anyone have any other suggestions as I've shot footage that can't be re-shot so I'm really stuck!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 10:44:32 PM
QuoteTwixtor may help save the footage but it is always recommended to shoot in high fps such as 48, 50 or 60 as @Danne suggested.

DeafEyeJedi, I've leaned something today! From now on I know to shoot at higher fps when shooting HDR. Every day is a school day... Thanks!
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Danne on August 19, 2015, 10:48:19 PM
If you work batches or want to try hdr in raw/mlv you could try cr2hdr-r which utilizes jerrykils script and also adds abilty to use 3d luts and other things.
http://www.magiclantern.fm/forum/index.php?topic=13512.0
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: 5Dme on August 19, 2015, 10:54:54 PM
Cheers Danne, I'll have a look at it.
Title: Re: Mac workflow app/script for dual_iso and HDR video
Post by: Maestroxeta on December 12, 2016, 09:43:43 PM
Helo, I can't download the links, this appears to me:

     Forbidden

     You don't have permission to access /misc/kit_hdrvideo_v.03.zip on this server.
     Apache/2.4.10 (Debian) Server at bot-fly.com Port 80

I´ll be glad if someone could help me. :)