Author Topic: SlimRaw – CDNG compression tool  (Read 44633 times)

timbytheriver

  • Senior
  • ****
  • Posts: 439
SlimRaw – CDNG compression tool
« on: April 23, 2015, 10:43:14 AM »
Anyone seen/used this yet?

http://slimraw.com/

Best

Tim

PS I'm nothing to do with this company – I just saw it on Twitter!
5D3 1.1.3
5D2 2.1.2

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6462
Re: SlimRaw – CDNG compression tool
« Reply #1 on: April 23, 2015, 11:16:19 AM »
Seems it can create cdng files of regular dng,s. That,s good.

SamoMalo404

  • New to the forum
  • *
  • Posts: 6
Re: SlimRaw – CDNG compression tool
« Reply #2 on: April 23, 2015, 12:21:05 PM »
Yes for sure it's interesting but how much cpu usage does it need?

Andy600

  • Moderator
  • Hero Member
  • *****
  • Posts: 1863
  • Have you tried turning it off and on again?
Re: SlimRaw – CDNG compression tool
« Reply #3 on: April 23, 2015, 01:56:32 PM »
I have it and it's fast!

Had some issues with DNGs in Premier Pro but ran them through the adobe converter first and then Slimraw - they open and playback in Premier Pro CC2014 without a problem. The actual compression you get depends on the original file (i.e. user does not set the amount). I get an average 40-50% file compression. Still need to do some pixel peeping.
Colorist working with Davinci Resolve, Baselight, Nuke, After Effects & Premier Pro. Occasional Sunday afternoon DOP. Developer of Cinelog-C Colorspace Management and LUTs - www.cinelogdcp.com

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6462
Re: SlimRaw – CDNG compression tool
« Reply #4 on: April 23, 2015, 03:41:39 PM »
Why adobe dng converter? Don,t the raw/mlv produced dng files convert straight away?

Andy600

  • Moderator
  • Hero Member
  • *****
  • Posts: 1863
  • Have you tried turning it off and on again?
Re: SlimRaw – CDNG compression tool
« Reply #5 on: April 23, 2015, 04:09:40 PM »
@Danne - All DNGs seem to convert ok but I had an issue with some cDNG sequences not being read by Premier or Speedgrade - I ran these through the Adobe app then Slimraw and it fixed them. I still need to find out what the issue was.

With my very minimal testing this seems to be a very good app and gets a folder of DNGs down to a similar size as a ProRes 4444 xq transcode although I would still probably transcode for editing and convenience.
Colorist working with Davinci Resolve, Baselight, Nuke, After Effects & Premier Pro. Occasional Sunday afternoon DOP. Developer of Cinelog-C Colorspace Management and LUTs - www.cinelogdcp.com

cpc

  • New to the forum
  • *
  • Posts: 37
Re: SlimRaw – CDNG compression tool
« Reply #6 on: April 23, 2015, 05:29:11 PM »
Thanks Andy for supporting slimRAW and thanks Tim for posting the link.

I believe Andy means he has converted the original uncompressed files with slimRAW and the compressed output works in Premiere/Speedgrade CC. I would be surprised myself if slimRAW actually makes DNGConverter files compatible with Premiere. :) It will in the future, but does not currently.

Uncompressed DNG and CinemaDNG should work fine in Premiere/Speedgrade CC after slimRAW compression. In fact, if a slimRAW output file does not work with Adobe CC I'd very much like to have a look at the original file. :)

@SamoMalo404: slimRAW will work on any x86-64 processor. Obviously, the more power you have available, the better. But it is fast enough that in the majority of cases storage bandwidth is the bottleneck, not the CPU.
FWIW, on my quad-core Intel i7-4770 3.4ghz running at stock core speed FullHD 5d mark3 14-bit DNG footage converts at around 95-100fps (off an SSD). Now obviously you need fast storage to achieve such speeds (SSD and/or RAID), an HDD simply can't do it physically. In any case, slimRAW will work with whatever is available on the system, at the bandwidth available.

You can read a bit more here:
http://www.shutterangle.com/2015/slimraw-cinemadng-raw-video-lossless-compressor/

Andy600

  • Moderator
  • Hero Member
  • *****
  • Posts: 1863
  • Have you tried turning it off and on again?
Re: SlimRaw – CDNG compression tool
« Reply #7 on: April 23, 2015, 05:53:29 PM »
Yes, it was a very old set of DNGs that I couldn't open in PP. I think they were converted with an early version of raw2cdng. Running them through SlimRaw didn't fix the issue but running them through the Adobe converter (set to uncompressed v1.3) first then SlimRaw did the trick.

It's a great app @cpc and I would certainly recommend it! :)
Colorist working with Davinci Resolve, Baselight, Nuke, After Effects & Premier Pro. Occasional Sunday afternoon DOP. Developer of Cinelog-C Colorspace Management and LUTs - www.cinelogdcp.com

cpc

  • New to the forum
  • *
  • Posts: 37
Re: SlimRaw – CDNG compression tool
« Reply #8 on: April 27, 2015, 11:09:44 PM »
The new version of slimRAW adds a trial mode. In trial mode a few frames of each dng/cinemadng sequence will be converted. This way expected compression ratios can be previewed and the compressed frames can be tested and pixel peeped in Resolve, Premiere, Speedgrade, Scratch, etc. :)

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6462
Re: SlimRaw – CDNG compression tool
« Reply #9 on: April 28, 2015, 12:02:05 AM »
Cool stuff!

Lars Steenhoff

  • Senior
  • ****
  • Posts: 460
Re: SlimRaw – CDNG compression tool
« Reply #10 on: April 28, 2015, 11:34:34 AM »
Would be cool to have this integrated in to a hot folder.
to transfer files to a folder and they would be automatically converted to compressed DNG with this tool.


Or what would be nice too is to convert directly from MLV to Compressed DNG.

janoschsimon

  • New to the forum
  • *
  • Posts: 44
Re: SlimRaw – CDNG compression tool
« Reply #11 on: April 28, 2015, 01:49:17 PM »
im with lars :-)

compress mlv would be awesome just like r3d ;-)

cheers janosch

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3369
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
SlimRaw – CDNG compression tool
« Reply #12 on: May 02, 2015, 06:25:13 PM »
Definitely following this thread from here on out...

Thanks @cpc!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Kharak

  • Hero Member
  • *****
  • Posts: 943
Re: SlimRaw – CDNG compression tool
« Reply #13 on: May 12, 2015, 11:13:32 PM »
Does anyone have any comparisons between CinemaDNG from raw2dng, preferably converted to 12 bit and 16 bit ? and then slimraw CinemaDNG of 12 bit and 16 bit conversion?

Would be nice if someone could post the files via dropbox or something alike so I could pixel peep.
once you go raw you never go back

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6462
Re: SlimRaw – CDNG compression tool
« Reply #14 on: May 12, 2015, 11:28:11 PM »
Why don,t you test yourself? You get a few frames in demo mode to check. I have the application and it slims the files in no time.

Kharak

  • Hero Member
  • *****
  • Posts: 943
Re: SlimRaw – CDNG compression tool
« Reply #15 on: May 12, 2015, 11:34:14 PM »
Hmm.. I didn't catch that part!

Thank you. I go pixel peep!
once you go raw you never go back

Markus

  • Senior
  • ****
  • Posts: 338
Re: SlimRaw – CDNG compression tool
« Reply #16 on: May 13, 2015, 12:27:31 AM »
A compression tool like this that could put the compressed DNGs back into a MLV container, directly playable with mlv viewer and mountable with mlvfs would be a fantastic way to save storage space in archiving.

dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: SlimRaw – CDNG compression tool
« Reply #17 on: May 13, 2015, 01:51:18 AM »
You mean something like this. See the OP of the MLVFS thread under the section "MLV Compression" for more info.

cpc

  • New to the forum
  • *
  • Posts: 37
Re: SlimRaw – CDNG compression tool
« Reply #18 on: May 13, 2015, 01:28:14 PM »
@Kharak:
12 and 16 bit dng will work fine, but for normal Canon ML footage there is no reason to lose precision converting bitdepth down to 12-bit, nor is there a reason to increase size going 16-bit. 16-bit in particular has no advantage whatsoever, and the compressed 16-bit files will be marginally bigger compared to the 14-bit compressed files.

Dual ISO is another story, since it is 16-bit already, AFAIK.


@Markus:
I am not sure why would you want to do this? The compressed cDNG is already compressed (obviously), so it is good for both archiving and production as is since lossless CinemaDNG is standard and compatible with a wide range of software. And if you only want to quickly preview sequences, you can drop them in either Scratch Play or Resolve Lite.

dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: SlimRaw – CDNG compression tool
« Reply #19 on: May 13, 2015, 01:57:47 PM »
I am not sure why would you want to do this?
There are certainly advantages to only needing to archive a single MLV file per clip, rather than thousands of individual CDNG files.

hi_immiles

  • New to the forum
  • *
  • Posts: 4
Re: SlimRaw – CDNG compression tool
« Reply #20 on: May 13, 2015, 06:10:15 PM »
Yes! Thanks for posting this. Excited to try out slimraw

Markus

  • Senior
  • ****
  • Posts: 338
Re: SlimRaw – CDNG compression tool
« Reply #21 on: May 13, 2015, 08:55:51 PM »
There are certainly advantages to only needing to archive a single MLV file per clip, rather than thousands of individual CDNG files.

Exactly, there is an advantage to have the data in one big chunk. There is a storage difference when they are saved in small separate files on the harddrive vs mlv container and if you whant to move the data a big chunk of a file will get higher transfer speeds. Also you have hot pixel fix and stripe removal options still available when you can mount the files with mlvfs.

Markus

  • Senior
  • ****
  • Posts: 338
Re: SlimRaw – CDNG compression tool
« Reply #22 on: May 13, 2015, 09:12:31 PM »
@dmilligan Would love to try out your compression option but  I'm on Windows here.

Kharak

  • Hero Member
  • *****
  • Posts: 943
Re: SlimRaw – CDNG compression tool
« Reply #23 on: May 13, 2015, 09:58:09 PM »
Reason for 16 bit is computational.. Or so I read on these forums quite some time ago.

It is more CPU intensive with 14 bit compared to 16 bit, because 14 bit is not on pair with 2-4-6-16-32 etc..

I believe it was in the The CinemaDNG Discussion thread that Chmee mentioned this and therefore 2 extra "empty" bits are added in RAW2CDNG conversion.
once you go raw you never go back

cpc

  • New to the forum
  • *
  • Posts: 37
Re: SlimRaw – CDNG compression tool
« Reply #24 on: May 13, 2015, 11:05:00 PM »
Quote from: Kharak
Reason for 16 bit is computational.. Or so I read on these forums quite some time ago.

It is more CPU intensive with 14 bit compared to 16 bit, because 14 bit is not on pair with 2-4-6-16-32 etc..

I believe it was in the The CinemaDNG Discussion thread that Chmee mentioned this and therefore 2 extra "empty" bits are added in RAW2CDNG conversion.

Well, there is a minor unpacking overhead with 14-bit uncompressed files, but that's probably offset by the fact that 1/7 more data needs to be read from storage with 16-bit uncompressed files; and storage is the slowest link in the processing chain.

With compressed files there is no overhead with 14-bit files compared to 16-bit.