Switch for macOS Catalina/Linux (former cr2hdr.app)

[12georgiadis]

Danne, incredible workflow !
With this update, I think proxy can work as offline/online workflow editing
1) MLV/proxy => switch => clean proxy and sound with dng synched
2) edit with clean proxys for editing
3) lock edit => XML => Resolve => conform by name => online edit with synched dng
I'll try to test but that can save a lot of time and storage space

[Danne]

Hopefully yes. Please test and report back how it goes .

[12georgiadis]

Ok, crossfinger ;-)

@Danne, @Alex, MLV are recording fine in CF by default, but for H264 proxy, I have to select SD card again in canon menu each time I turn off/on the camera. Is there a special setting to keep it in memory ?

[Danne]

Set preferred card CF in ML menu to off.
http://www.magiclantern.fm/forum/index.php?topic=15108.msg189323#msg189323

By the way. Will refine proxy process to this:
http://www.magiclantern.fm/forum/index.php?topic=19300.msg189351#msg189351

[12georgiadis]

Ok it worked for SD/CF management by disabling the function in ML menu.

[Danne]

New download.

I rewrote proxy script parts. Should now match precisely since calculating ending part derived from actual amount of dng frames.
http://www.magiclantern.fm/forum/index.php?topic=19300.msg189351#msg189351

Commit:
https://bitbucket.org/Dannephoto/switch/commits/13104b4d77d3a78656dcd28c0c10a62c7d7427d7

[12georgiadis]

Danne, where is the option to sync proxy/sound/mlv in switch ?

[Danne]

No option. Automated. Just include your proxy files together with your MLV files and run Switch the normal way.
http://www.magiclantern.fm/forum/index.php?topic=15108.msg189314#msg189314

Also:
I just uploaded a new version which supports (C) changing to an alternate output folder.

[motionSOUL]

Hello Danne,

I would like to replace all my old MLV workflow with Switch to speed up the process…
My concern for the moment is the White Balance, how can I manage it like in CR for example where I can tweek Temperature and Tint?
Is it possible to do this from Switch?

Second question, I use Cinelog-C (http://www.cinelogdcp.com/) to convert my MLV footages.
Is it possible to apply it directly from Switch as I don't know if it is some sort of LUT or not (the file extension is .dcp for the 5DMKIII)?

Thanks for any help on this.

S/.

[Danne]

Cool. Hope you´ll like it.
You can use DCP profiles on your dng files. In ACR/lightroom that is. All tags needed are provided in dng metadata.
Regarding white balance. White balance from camera is added. Then you need to refine it in your nle.
There is one way to create wb coordinates. You will need imageJ installed and then a good portion of patience as it´s about picking points on a tmp tiff file, go to next pick and save point etc. You find that workflow in (m) menu (mlv_dump at the bottom). Nice thing here is that white balance is actually transformed into actual dng AsShotNeutral numbers.
If you plan on exporting to prores from within Switch I suggest you try one of the provided logs.

[12georgiadis]

Ok, I did a test with a folder containing .MLV (comp raw) + proxy with sound. I just ran switch without touching any options. It created me 5 types of files :
1) X proxy (APR LT or Proxy 36) black frames
2) X 444 (APR 444) black frames
3) APR LT or Proxy 36 no black frames no sound
4) APR 444 no black frames no sound
5) CDNG no sound
 
Is there a way to get a trimmed (no reencoding) canon H264 .mov + sound w/o blackframe ? I'd like to test it to edit offline, and then make an online edit on resolve with CDNG using MLVFS. It could be a fast and lightweight workflow.

[aschille84]

Is there a way to get a trimmed (no reencoding) canon H264 .mov + sound w/o blackframe ? I'd like to test it to edit offline, and then make an online edit on resolve with CDNG using MLVFS. It could be a fast and lightweight workflow.

Sounds like a good workflow

[Danne]

Is there a way to get a trimmed (no reencoding) canon H264 .mov + sound w/o blackframe ?

Do following:
1 - Fill a folder with proxy H.264 and MLV files
2 - Open Switch and in the first menu select (R) to reset Switch.
3 - From the same menu select (r) to run Switch

What do you get?
It should be as straight as selecting (r) from the first menu.

The proxies and the mlv files are named the same right?

[Lars Steenhoff]

I'm not getting the Wav file, I'm using the test video that you also have Danne, any idea what I could be doing wrong?

And also a request, can you make an option to leave the original footage in place to where it is and only make a output directory with the new files?

[Danne]

The wav file should be inside the dng folder next to your dng files.

You mean leave the original MOV alone and move the cleaned MOV to a specific proxy folder?

[Lars Steenhoff]

Yes leave footage alone and make only new output folders with new files.

For example if I have a compact flash card mounted, I can select the folder and it would not touch the files, only create new folder on my computer and save all new files to my ssd.

I could not find the Wav file in the DNG folder with the latest build ( like 25 min ago )

[Danne]

I'll have a look within a couple of hours.
Could you test with another file as well?

[Lars Steenhoff]

Cool, I wil do more tests

[Danne]

Tested and your file is working over here. Sure you didn´t run your prores file without the audio? Also check through the whole folder make sure you didn´t miss the wav file somewhere.
If you test with another file and it´s still not working I need to see the LOG.txt file.

[Lars Steenhoff]

Here's the log file, I looked for the wav but it seems it was not created

Code: [Select]

ls: *.RAW: No such file or directory
ls: *.RAW: No such file or directory
File not found: /tmp/DUALISO/what_cam_000000.dng
File not found: /tmp/DUALISO/what_cam_000000.dng
File not found: /tmp/DUALISO/what_cam_000000.dng
rm: /tmp/DUALISO/what_cam_000000.dng: No such file or directory
ls: /tmp/DUALISO/what_cam_lock: No such file or directory
ls: *.mlv: No such file or directory
ls: *.mlv: No such file or directory
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
/tmp/DUALISO/DUALISO
cat: /tmp/_X_Proxy: No such file or directory
cat: /tmp/_X_Proxy: No such file or directory
cat: /tmp/_X_ProRes4444: No such file or directory
cat: /tmp/DUALISO/FLATFRAMES: No such file or directory
cat: /tmp/DUALISO/FLATFRAMES: No such file or directory
[ERROR] Failed to open file ''
cat: /tmp/DUALISO/FLATFRAMES: No such file or directory
cat: /tmp/DUALISO/FLATFRAMES: No such file or directory

 MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: ''
   - Rewrite MLV
   - Output only one frame with averaged pixel values
   - Output into 'ft__'
[ERROR] Failed to open file ''
rm: *_.wav: No such file or directory
cat: /tmp/DUALISO/FLATFRAMES: No such file or directory
mv: : No such file or directory
ls: *.mlv: No such file or directory
[ERROR] Failed to open file 'ft_*.MLV'
mv: rename avg_*.MLV to A_ORIGINALS/avg_*.MLV: No such file or directory
mv: rename ft_*.MLV to A_ORIGINALS/ft_*.MLV: No such file or directory
ls: *.mlv: No such file or directory
ls: *.mlv: No such file or directory
cat: /tmp/DUALISO/badpixelMLVab: No such file or directory
cat: /tmp/DUALISO/badpixelMLVac: No such file or directory
cat: /tmp/DUALISO/badpixelMLVad: No such file or directory
5D Mark
953A9793.MLV
ls: *.mlv: No such file or directory
ls: /tmp/DUALISO/mlv_dump_TIME: No such file or directory
ls: *.mlv: No such file or directory
cat: /tmp/DUALISO/MLVFILESab: No such file or directory
cat: /tmp/DUALISO/MLVFILESac: No such file or directory
cat: /tmp/DUALISO/MLVFILESad: No such file or directory
cat: /tmp/output: No such file or directory
cat: /tmp/output: No such file or directory
mv: rename 953A9793.M* to 953A9793_1_2017-08-27_0001_C0000/953A9793.M*: No such file or directory
mv: rename 953A9793.WB to 953A9793_1_2017-08-27_0001_C0000/953A9793.WB: No such file or directory
ls: *953A9793.map: No such file or directory
ls: *.xls: No such file or directory
cat: /tmp/mlv_dump_settings: No such file or directory
cat: /tmp/output: No such file or directory

 MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: '953A9793.MLV'
   - Decompressing before writing DNG
   - Enforcing 14bpp for DNG output
   - Convert to DNG frames
   - Output into '953A9793_1_2017-08-27_0001_C0000_'
File 953A9793.MLV opened
File 953A9793.M00 not existing.
Processing...

Vertical stripes correction:
  1.000  1.000  1.000  0.999  0.999  1.002  1.001  1.005

Frame0 : cold pixels found: 0                             

Reached end of chunk 1/1 after 328 blocks
Processed 315 video frames at 25.00 FPS (12.60 s)
Done

ffmpeg version 3.3 Copyright (c) 2000-2017 the FFmpeg developers
  built with Apple LLVM version 6.1.0 (clang-602.0.53) (based on LLVM 3.6.0svn)
  configuration: --prefix=/Volumes/tempdisk/sw --as=yasm --enable-gpl --enable-version3 --enable-pthreads --disable-ffplay --disable-ffserver --disable-shared --enable-static --enable-libvpx --disable-decoder=libvpx --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libx265 --enable-libxvid --enable-zlib --enable-avfilter --enable-fontconfig --enable-libfreetype --enable-libass --enable-libvidstab --enable-libsnappy --enable-filters --enable-postproc --enable-runtime-cpudetect --disable-indev=qtkit --disable-indev=x11grab_xcb
  libavutil      55. 58.100 / 55. 58.100
  libavcodec     57. 89.100 / 57. 89.100
  libavformat    57. 71.100 / 57. 71.100
  libavdevice    57.  6.100 / 57.  6.100
  libavfilter     6. 82.100 /  6. 82.100
  libswscale      4.  6.100 /  4.  6.100
  libswresample   2.  7.100 /  2.  7.100
  libpostproc    54.  5.100 / 54.  5.100
Invalid duration specification for ss: -i
ffmpeg version 3.3 Copyright (c) 2000-2017 the FFmpeg developers
  built with Apple LLVM version 6.1.0 (clang-602.0.53) (based on LLVM 3.6.0svn)
  configuration: --prefix=/Volumes/tempdisk/sw --as=yasm --enable-gpl --enable-version3 --enable-pthreads --disable-ffplay --disable-ffserver --disable-shared --enable-static --enable-libvpx --disable-decoder=libvpx --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libx265 --enable-libxvid --enable-zlib --enable-avfilter --enable-fontconfig --enable-libfreetype --enable-libass --enable-libvidstab --enable-libsnappy --enable-filters --enable-postproc --enable-runtime-cpudetect --disable-indev=qtkit --disable-indev=x11grab_xcb
  libavutil      55. 58.100 / 55. 58.100
  libavcodec     57. 89.100 / 57. 89.100
  libavformat    57. 71.100 / 57. 71.100
  libavdevice    57.  6.100 / 57.  6.100
  libavfilter     6. 82.100 /  6. 82.100
  libswscale      4.  6.100 /  4.  6.100
  libswresample   2.  7.100 /  2.  7.100
  libpostproc    54.  5.100 / 54.  5.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '953A9793.MOV':
  Metadata:
    major_brand     : qt 
    minor_version   : 512
    compatible_brands: qt 
    encoder         : Lavf57.71.100
  Duration: 00:00:13.21, start: 0.000000, bitrate: 30078 kb/s
    Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709), 1920x1080 [SAR 1:1 DAR 16:9], 28550 kb/s, 25 fps, 25 tbr, 25k tbn, 50k tbc (default)
    Metadata:
      handler_name    : DataHandler
      timecode        : 17:54:07:22
    Stream #0:1(eng): Audio: pcm_s16le (sowt / 0x74776F73), 48000 Hz, stereo, s16, 1536 kb/s (default)
    Metadata:
      handler_name    : DataHandler
    Stream #0:2(eng): Data: none (tmcd / 0x64636D74), 0 kb/s
    Metadata:
      handler_name    : DataHandler
      timecode        : 17:54:07:22
Output #0, mov, to 'n953A9793.MOV':
  Metadata:
    major_brand     : qt 
    minor_version   : 512
    compatible_brands: qt 
    encoder         : Lavf57.71.100
    Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 28550 kb/s, 25 fps, 25 tbr, 25k tbn, 25k tbc (default)
    Metadata:
      handler_name    : DataHandler
      timecode        : 17:54:07:22
    Stream #0:1(eng): Audio: pcm_s16le (sowt / 0x74776F73), 48000 Hz, stereo, s16, 1536 kb/s (default)
    Metadata:
      handler_name    : DataHandler
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
frame=  315 fps=0.0 q=-1.0 Lsize=   46407kB time=00:00:12.58 bitrate=30210.0kbits/s speed= 247x   
video:44034kB audio:2364kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.017785%
cat: /tmp/output: No such file or directory
ffmpeg version 3.3 Copyright (c) 2000-2017 the FFmpeg developers
  built with Apple LLVM version 6.1.0 (clang-602.0.53) (based on LLVM 3.6.0svn)
  configuration: --prefix=/Volumes/tempdisk/sw --as=yasm --enable-gpl --enable-version3 --enable-pthreads --disable-ffplay --disable-ffserver --disable-shared --enable-static --enable-libvpx --disable-decoder=libvpx --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libx265 --enable-libxvid --enable-zlib --enable-avfilter --enable-fontconfig --enable-libfreetype --enable-libass --enable-libvidstab --enable-libsnappy --enable-filters --enable-postproc --enable-runtime-cpudetect --disable-indev=qtkit --disable-indev=x11grab_xcb
  libavutil      55. 58.100 / 55. 58.100
  libavcodec     57. 89.100 / 57. 89.100
  libavformat    57. 71.100 / 57. 71.100
  libavdevice    57.  6.100 / 57.  6.100
  libavfilter     6. 82.100 /  6. 82.100
  libswscale      4.  6.100 /  4.  6.100
  libswresample   2.  7.100 /  2.  7.100
  libpostproc    54.  5.100 / 54.  5.100
953A9793_1_2017-08-27_0001_C0000_.wav: No such file or directory
rm: 953A9793_1_2017-08-27_0001_C0000_.wav: No such file or directory
2017-09-01 11:41:36 953A9793_1_2017-08-27_0001_C0000.wav: File does not exist

cat: /tmp/output: No such file or directory
mkdir: : No such file or directory
cat: /tmp/output: No such file or directory
mv: rename 953A9793.M* to /Users/thunderbook/Desktop/sync/black/cut/A_ORIGINALS/953A9793.M*: No such file or directory
cat: /tmp/A_cr2hdr_settings.txt: No such file or directory
cr2hdr: a post processing tool for Dual ISO images

Last update: ab1e90c on 2015-11-24 09:50:19 UTC by a1ex:
cr2hdr: moved safeguard from median_int_wirth to kth_smallest_i...

Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)
--wb=graymax    : set AsShotNeutral by maximizing the number of gray pixels (default)

Input file      : 953A9793_1_2017-08-27_0001_C0000_000000.dng
Camera          : Canon EOS 5D Mark III
Full size       : 1920 x 1080
Active area     : 1920 x 1080
Doesn't look like interlaced ISO
Doesn't look like interlaced ISO
[ERROR] Failed to open file '/Users/thunderbook/Desktop/sync/black/cut/953A9793.MLV'
cat: /tmp/output: No such file or directory
ls: *.RAW: No such file or directory
ls: *.RAW: No such file or directory
ls: /tmp/DUALISO/FULL_AUTO: No such file or directory
wc: _1_2017-09-01_0001_C0000/pix_fix.txt: open: No such file or directory
wc: _1_2017-09-01_0001_C0000/pix_fix.txt: open: No such file or directory
cat: /tmp/FFmpeg_settingsPR: No such file or directory
cat: /tmp/FFmpeg_settingsPR: No such file or directory
cat: /tmp/FFmpeg_settings: No such file or directory
ls: *.CR2: No such file or directory
ls: /tmp/DUALISO/FULL_AUTO: No such file or directory
ls: *.CR2: No such file or directory
ls: *.DNG: No such file or directory
ls: *.dng: No such file or directory
No matching processes belonging to you were found
Total running time:   
0 Days, 00 Hrs, 00 Min, 11 Sec(B
X to FFmpeg ProRes:   
XxXx(B
mlv_dump:   
0 Days, 00 Hrs, 00 Min, 07 Sec(B
raw2dng:   
XxXx(B
dcraw_FFmpeg ProRes:   
XxXx(B
cr2hdr(CR2 files):   
XxXx(B

(q) Exit(B


[Danne]

You didn´t try another proxy file with corresponding MLV?

If still trying the same file I need to check the MOV you´re using. It still has the black frames when included with the MLV? Can you upload the exact MOV you´re using?

[Lars Steenhoff]

Yes I did another test with another video and its fine,   I don't know whats wrong with the previous video.

[Lars Steenhoff]

Ah I found it, sorry I was using the .mov file with already had the black frames cut of.

User error.

[Danne]

Could you upload it? As asked before. Are you using the prores file?(there is no audio in it)
Are you using a file that has been "cleaned" already?
I uploaded a new version for any rare occasion when there is no black frames in the beginning of a file. Probably never happwns but still...

Ok, good saw your answer. You can try this latest version and see if it works on a cleaned file.

[Lars Steenhoff]

Yes the latest version works also with the already cut files, Thanks for the update

And if you can have a look at not changing the source files directory that would be good for my usage.

I always get paranoid if my footage gets moved around and I don't know where it ends up.
this makes me do a backup first that takes more space, so I prefer it to be untouched and only create new files in subfolders / custom folder