Magic Lantern Forum

Using Magic Lantern => Raw Video => Raw Video Postprocessing => Topic started by: chmee on May 17, 2014, 01:34:38 AM

Title: ML Samplefiles
Post by: chmee on May 17, 2014, 01:34:38 AM
i discovered, i cant deliver good code, if i dont have any examples from other bodies than mine. so i ask here for more samplefiles. these are the rules for good footage:

* resolution is not important, but should be higher than 1280px width.
* very important: high dynamics with overexposures and black/dark areas.
* something (blackwhite) with details/pattern
* colors, maybe you've got a colorchecker or you print out any testpattern. (examples 01 (http://www.bealecorner.com/trv900/respat/color-chart.png), 02 (http://videomapping.org/wp-content/uploads/2011/05/1280x1024.jpg), 03 (http://upload.wikimedia.org/wikipedia/commons/1/1e/ColorChecker100423.jpg))
* infos, you should deliver: body, original firmwareversion, ml-build, hack On/off, Blacklevelfix On/off, Cropmode Yes/No?
* mlv or raw file should be maximum ~80mb, i/we just need some frames (5-15)
* audio is good, but not necessary

* if you dont know, where to host your files, send it to me (raw2cdng@phreekz.de), i'll put them into the same path as the others

regards chmee
Title: Re: ML Samplefiles
Post by: chmee on May 17, 2014, 01:42:34 AM
until now ted ramasola helped me with 5DII and 7D files, would be great to get some more from other bodies.

(http://dl.phreekz.de/raw2cdng/ML_Samples/5DII_14may14_blfixOFF.jpg)
[5DII][tedramasola]
5DII 14may14 blfix/off MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/5DII_14may14_blfixOFF.MLV)
5DII 14may14 blfix/on MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/5DII_14may14_blfixON.MLV)

(http://dl.phreekz.de/raw2cdng/ML_Samples/5DIII_113_14apr13_blfixON.jpg)
[5DIII][chmee]
5DIII 1.13 14apr13 blfix/on MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/5DIII_113_14apr13_blfixON.MLV)
5DIII 1.13 14apr13 blfix/off MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/5DIII_113_14apr13_blfixOFF.MLV)

(http://dl.phreekz.de/raw2cdng/ML_Samples/7D_14may14_blfixON.jpg)
[7D][tedramasola]
7D 14may14 blfix/on MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/7D_14may14_blfixON.MLV)
7D 14may14 blfix/off MLV (http://dl.phreekz.de/raw2cdng/ML_Samples/7D_14may14_blfixOFF.MLV)
Title: Re: ML Samplefiles
Post by: g3gg0 on May 17, 2014, 02:23:48 PM
(thanks for this contribution! :) )
Title: Re: ML Samplefiles
Post by: chmee on May 20, 2014, 10:00:52 AM
dear ML-Users :) pleeeaase, i/we need more Samples, i miss M/100D/650D/50D and so on. and of course some older and newer builds of shown bodies (fi 5DIII FW 1.2.3) are taken as well..

regards chmee
Title: Re: ML Samplefiles
Post by: Stedda on May 20, 2014, 01:44:29 PM
I'll take care of 5D III later on today. Newest Nightly.
Title: Re: ML Samplefiles
Post by: glubber on May 22, 2014, 01:35:32 PM
I made some samples with my 550D which can be downloaded here:

https://www.dropbox.com/sh/35jtthhco4m0lzf/AABHCkHMCrQZgFXf0umzS_tYa (https://www.dropbox.com/sh/35jtthhco4m0lzf/AABHCkHMCrQZgFXf0umzS_tYa)

MLV/ Raw samples captured with builds from Jan19_2014, May21_2014 and Jun06_2013
Videomode: 1080p25, no crop

For additional info see textfile
Title: Re: ML Samplefiles
Post by: Audionut on September 16, 2014, 05:09:59 AM
I have some 6D files (ISOs 100-6400) if you're still interested.

(http://i.imgur.com/t4AsAv8.jpg)

Brightened 4 stops in post.
(http://i.imgur.com/nz7nvsD.jpg)


And crop framing.
(http://i.imgur.com/gOSWLg4.jpg)


If the exposure and framing is suitable, I can upload at the end of this week.
Title: Re: ML Samplefiles
Post by: chmee on September 20, 2014, 11:51:41 PM
@audionut of course, its not only for me, its interesting for everyone, who want to test this format.

@chadmuffin gave me two files with verticalbanding, they were shortened with mlvdiag, so the last frame is broken (one thing a converter should cope with as well )

(http://dl.phreekz.de/raw2cdng/ML_Samples/M11-1526.VB.jpg)
download 55mb M11-1526.vb.mlv (http://dl.phreekz.de/raw2cdng/ML_Samples/M11-1526.VB.mlv)
provided by @chadmuffin

(http://dl.phreekz.de/raw2cdng/ML_Samples/M11-1529.VB.jpg)
download 55mb M11-1529.vb.mlv (http://dl.phreekz.de/raw2cdng/ML_Samples/M11-1529.VB.mlv)
provided by @chadmuffin

regards chmee
Title: Re: ML Samplefiles
Post by: chmee on October 02, 2014, 09:50:21 AM
someone maybe can deliver files that need chroma-smoothing? AF-On-Sensor? Dead/Hotpixel?

regards chmee
Title: Re: ML Samplefiles
Post by: glubber on October 02, 2014, 01:53:32 PM
someone maybe can deliver files that need chroma-smoothing? AF-On-Sensor? Dead/Hotpixel?

regards chmee

Do you mean something like this? This Raw-file has some weird pixels, but i'm not shure if those are hotpixels

(https://dl.dropboxusercontent.com/u/90483500/MAGICLANTERN/M06-204500747.jpg)

ML-RAW June 2013 ca. 750 MB
Title: Re: ML Samplefiles
Post by: chmee on October 02, 2014, 04:47:53 PM
yeah, thats a good example for both, hot and dead pixels. interesting as well are Eos M, 650D because of their On-Sensor-AF-Area.
Title: Re: ML Samplefiles
Post by: glubber on October 04, 2014, 02:03:24 PM
yeah, thats a good example for both, hot and dead pixels. interesting as well are Eos M, 650D because of their On-Sensor-AF-Area.

Sample file:
ML-RAW June 2013--EOS 550D
https://www.dropbox.com/s/x23mem3vd08k9rm/M07-2201.RAW?dl=0 (https://www.dropbox.com/s/x23mem3vd08k9rm/M07-2201.RAW?dl=0)

(https://dl.dropboxusercontent.com/u/90483500/MAGICLANTERN/2013-08-07_2205-00081.jpg)
Title: Re: ML Samplefiles
Post by: Audionut on October 07, 2014, 03:46:58 AM
https://www.dropbox.com/sh/m99pko0lrp3uj7n/AAAdy6HO4-DC2isnCtxbI0u8a?dl=0

A bunch of 6D MLV files at varying ISOs.  All options in MLV were off (black level fix, extra hacks etc), and the files were shortened to 5 frames using mlv_dump (-o output.mlv -f 5 input.mlv).
Title: Re: ML Samplefiles
Post by: chmee on April 09, 2015, 01:50:09 PM
Now here some Dual ISO Samplefiles from 5DIII with +3ELV (ML from ~31.03.2015)

3 Sets of CR2 - normal versus DualISO (http://dl.phreekz.de/raw2cdng/ML_DualISO_Tests.zip)

1. Recovering Shadows
(https://farm8.staticflickr.com/7621/16853740900_b655a2e0d9_c.jpg) (https://flic.kr/p/rFiPZE)

2. Resolution Artifacts
(https://farm8.staticflickr.com/7671/16855058769_cc83f93395_c.jpg) (https://flic.kr/p/rFqzKx)

3. Chroma Artifacts
(https://farm8.staticflickr.com/7717/16833861037_93c38d07fa_c.jpg) (https://flic.kr/p/rDxWpp)

regards chmee
Title: Re: ML Samplefiles
Post by: N/A on April 18, 2015, 04:32:10 AM
I've got some 600D raw files from when raw video was first implemented if you need some sample files of those as well. Complete with dead pixels and significant lack of any type of metadata  :D
Title: Re: ML Samplefiles
Post by: chmee on April 18, 2015, 04:05:21 PM
:D just make them downloadable here :)
Title: Re: ML Samplefiles
Post by: Slasheal on August 10, 2015, 11:19:59 AM
Some 7D mlv sample files with last fw:

https://mega.co.nz/#!VwUjjLSJ!kAJ8QvQhXfHty1Y6iWqSbysorMdHrpdv-iWY8-Bh9bM

4 files: 16/9, 2.35/1, and two cropped/squashed 50fps files.
Title: Re: ML Samplefiles
Post by: Tullen on August 10, 2015, 05:28:36 PM
Will try to fix some 50d sample files, but might have to wait until end of the month.
Title: Re: ML Samplefiles
Post by: Kharak on April 05, 2016, 03:40:50 AM

https://mega.nz/#!REQFSLBC!1uvZCODlMYh2udDqeskf_dj-Uh_E8SQPs83-S52-KkU

5D MK III
MLV
1920x1038
Build: 2016-02-29
113
Title: Re: ML Samplefiles
Post by: Danne on December 18, 2016, 08:34:18 PM
Some short samples of 10bit, 12bit, 14bit filmed with a 5D mark III

10bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirYUJxZ0JPVzJsX0k/view?usp=sharing

12bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirckp3bFBqanNmbXc/view?usp=sharing

14bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirM1loSU9sYWxHeW8/view?usp=sharing


Title: Re: ML Samplefiles
Post by: chmee on December 29, 2016, 10:59:30 AM
thx @danne

could someone upload "eos m" files in 14 12 10bit?
Title: Re: ML Samplefiles
Post by: Danne on December 29, 2016, 12:02:38 PM
Sure, eos m, here you go.
https://bitbucket.org/Dannephoto/magic-lantern/downloads/eos_m_10bit_12bit_14bit.zip
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 08:47:11 PM
@A1lex: 5D3-123 (dfort)
build: magiclantern-raw_video_10bit_12bit.2017Jan05.5D3123
https://drive.google.com/file/d/0B9z8Y0rg-pu8YUlIMXlpWVBHWVk/view?usp=sharing

Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 09:27:48 PM
@A1lex: 7D203 (dfort)
build: magiclantern-raw_video_10bit_12bit.2017Jan05.7D203
https://drive.google.com/file/d/0B9z8Y0rg-pu8QzBhbFFOX29SZ0k/view?usp=sharing
Title: Re: ML Samplefiles
Post by: a1ex on January 10, 2017, 09:36:32 PM
Thanks; the second DNG doesn't contain any highlights.
Title: Re: ML Samplefiles
Post by: honza123 on January 10, 2017, 09:49:59 PM
@A1lex: Jan05.600D102 (dfort)
http://uschovna.cz/zasilka/LI69ZTZ4PKZY73JC-WZK/974B2X7PER
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 10:09:52 PM
@A1lex: 7D203 (dfort) with highlights
build: magiclantern-raw_video_10bit_12bit.2017Jan05.7D203
https://drive.google.com/file/d/0B9z8Y0rg-pu8SVJqSVJWM3NiVkE/view?usp=sharing
Title: Re: ML Samplefiles
Post by: a1ex on January 10, 2017, 10:17:26 PM
This one doesn't have clipped highlights either.
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 10:34:23 PM
@A1lex: 7D203 (dfort) with clipped highlights
build: magiclantern-raw_video_10bit_12bit.2017Jan05.7D203
https://drive.google.com/file/d/0B9z8Y0rg-pu8M0RyWFU5T3hCYkU/view?usp=sharing
Title: Re: ML Samplefiles
Post by: a1ex on January 10, 2017, 10:39:41 PM
Still can't find any clipped highlights...
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 10:43:41 PM
Ha ha... zebras shown on sky and roof.. I wll try again!   :P
Also RAW graph on bottom showed over!
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 10:47:20 PM
Ok, this one for sure!
https://drive.google.com/file/d/0B9z8Y0rg-pu8MEFZVUMwVllfdWc/view?usp=sharing
Title: Re: ML Samplefiles
Post by: budafilms on January 10, 2017, 11:09:15 PM
@a1ex

5d3_buildJUN5  (Experimental)

Done My King! ;)

https://www.dropbox.com/sh/l9oomd0oxd0hedu/AAAStdAyGQoSW-bpudjOzYQYa?dl=0
Title: Re: ML Samplefiles
Post by: a1ex on January 10, 2017, 11:13:08 PM
Ha ha... zebras shown on sky and roof.. I wll try again!   :P

I guess these were YUV-based zebras, not RAW.

The YUV (JPEG) overlays are known for false positives (http://www.magiclantern.fm/forum/index.php?topic=5149.msg31247#msg31247) when checking for overexposure.

Quote
Also RAW graph on bottom showed over!

This one might be a bug in the raw histogram; can you expose in the same way and then select Debug -> Dump image buffers?

The 99.99 percentile in your second 7D example is at 13281; to display "OVER", this value should be above 15000 on 7D. Maybe the weather just got darker when you captured the snapshot?
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 10, 2017, 11:31:43 PM
The whole enchilada!

VRAM0.PPM + Image buffers + dng

https://drive.google.com/file/d/0B9z8Y0rg-pu8bkZBb2lrR2RJTFU/view?usp=sharing
https://drive.google.com/file/d/0B9z8Y0rg-pu8cDlJSHgwS29SZ1k/view?usp=sharing
https://drive.google.com/file/d/0B9z8Y0rg-pu8SlljVFpVbzJtVFE/view?usp=sharing
Title: Re: ML Samplefiles
Post by: a1ex on January 10, 2017, 11:59:15 PM
These files do not show the bug we were talking about. The DNG file should be exposed in the same way as in your second 7D sample (that is, no clipped highlights in the DNG, but ML overlays should indicate overexposure).

Ha ha... zebras shown on sky and roof.. I wll try again!   :P
Also RAW graph on bottom showed over!
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 11, 2017, 12:11:13 AM
I see..   I will try to replicate the issue tomorrow.
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 11, 2017, 04:23:03 PM
@A1lex: unable to replicate..  7D must have been in some error condition.
Title: Re: ML Samplefiles
Post by: RenatoPhoto on January 11, 2017, 04:24:21 PM
Common people submit your samples...  :'(

see here: http://www.magiclantern.fm/forum/index.php?topic=5601.msg178087#msg178087
Title: Re: ML Samplefiles
Post by: Danne on January 11, 2017, 04:53:06 PM
Overexposed Canon EOSM
https://drive.google.com/file/d/0B4tCJMlOYfirSFZqTkhLeGpJcWc/view?usp=sharing
Title: ML Samplefiles
Post by: dfort on January 11, 2017, 07:53:38 PM
Overexposed 700D/T5i

https://www.dropbox.com/s/lj6uweb6kp6crw5/700D.dng?dl=0

[EDIT] I could actually recover the highlights with ACR so here's one that is way overexposed. (The build was straight from the raw_fixes branch.)

https://www.dropbox.com/s/ygzs09g16nrj95r/700D_overexposed.dng?dl=0
Title: Re: ML Samplefiles
Post by: DeafEyeJedi on January 11, 2017, 08:06:13 PM
OE 100D.101 (2017Jan06 from @nikfreak):

https://drive.google.com/open?id=0BwtFjiepFE4LcTZOdFZBRHFVUVU
Title: Re: ML Samplefiles
Post by: GutterPump on January 11, 2017, 09:02:33 PM
Here 3 DNG with different exposure from 550D : 05 JAN Dfort build

https://www.dropbox.com/sh/rm5957gasaly06i/AADGtPoi5kdxoT32XOSrzWh7a?dl=0


5DII : 05 JAN Dfort build

https://www.dropbox.com/sh/gzdtm399l31tjsm/AAAb_1Ppq3b0yXMXaCOoq-i0a?dl=0
Title: Re: ML Samplefiles
Post by: DeafEyeJedi on January 12, 2017, 12:17:15 AM
OE 70D.112 (2017Jan06 from @nikfreak):

https://drive.google.com/open?id=0BwtFjiepFE4LSV9VT1JScE45VU0
Title: Re: ML Samplefiles
Post by: Audionut on January 12, 2017, 07:41:18 AM
https://www.dropbox.com/s/a7zenmf6fj1hsgj/14bpp_6D_Sample_magiclantern-raw_video_10bit_12bit.2017Jan11.6D116.dng?dl=0
Title: Re: ML Samplefiles
Post by: a1ex on January 12, 2017, 06:02:04 PM
Yay, no more white level exceptions!

Still looking for:
- 1100D
- 500D
- 650D (likely similar to EOS M or 700D)
- 50D (likely similar to 5D2)
Title: Re: ML Samplefiles
Post by: Ilia3101 on January 12, 2017, 06:06:31 PM
I'm not sure if you're still looking for a 5D2 sample, but here ya go:
https://drive.google.com/file/d/0BwvDlbhZgsGGMWFnUHdLaXRZV2c/view?usp=sharing
Made sure to get some clipped highlights in there(RAW zebras)
Used a build by me from about 20 minutes ago + Danne's latest mac mlv_dump + --dng --no-fixcp --no-stripes
Title: Re: ML Samplefiles
Post by: Walter Schulz on January 12, 2017, 08:23:49 PM
- 650D (likely similar to EOS M or 700D)

Hope this is what you are looking for:
http://www.filedropper.com/650d14bit
Built from branch "raw_video_10bit_12bit".
Title: Re: ML Samplefiles
Post by: Danne on January 12, 2017, 08:36:49 PM
I,m at work and can't compile here but I have a 500D and 1100D here. Can someone point me to recent builds for these cameras? 
Title: Re: ML Samplefiles
Post by: Walter Schulz on January 12, 2017, 08:45:22 PM
1100D: https://builds.magiclantern.fm/experiments.html
500D: I will try to compile it for you.
Title: Re: ML Samplefiles
Post by: a1ex on January 12, 2017, 08:46:52 PM
500D is on dfort's builds.

For 1100D, please run the VRAM dumps sequence as well, in all video modes (details here (http://www.magiclantern.fm/forum/index.php?topic=12375.0)).
Title: Re: ML Samplefiles
Post by: Danne on January 12, 2017, 09:08:36 PM
500D
https://bitbucket.org/Dannephoto/magic-lantern/downloads/500D.dng

Gonna bring the 1100D home and check into it asap...

Thanks Walter, dfort saved the "500D"-day
Title: Re: ML Samplefiles
Post by: Danne on January 12, 2017, 11:54:46 PM
Was about to take an overexposed pic with a 1100D since I noticed there was a 1100D build in the experiments section. Unfortunately it gives tcc error undefined symbol. Pretty tired atm and not really into how to fix this.
Title: Re: ML Samplefiles
Post by: a1ex on January 13, 2017, 12:06:02 AM
Just VRAM dumps are fine, without loading any modules.
Title: Re: ML Samplefiles
Post by: dmilligan on January 13, 2017, 01:21:58 AM
Noticed you updated allocate-raw-lv-buffer.

Here's a silent DNG for 1100D from that branch (skip offsets are wrong I guess) https://dl.dropboxusercontent.com/u/74060/71590001.DNG
And zoom (photo): https://dl.dropboxusercontent.com/u/74060/71590002.DNG
Title: Re: ML Samplefiles
Post by: saulbass on January 14, 2017, 03:52:00 PM
As requested from http://www.magiclantern.fm/forum/index.php?topic=5601.msg178087#msg178087

here a sample 14bit dng from a 650D.104.

https://mega.nz/#!OlFnXLKY!gMXfH7JmxRODOsqS9Klvsao3Yd02kj4SwteyY-rHOgg

using magiclantern-raw_video_10bit_12bit.2017Jan13.650D104

14bit
no other modules loaded
over exposed still frame from a short mlv.
extracted using mlv_dump --dng --no-fixcp --no-stripes *.MLV

The tearing from earlier builds has now gone which is great.

Amazing work - many thanks.

Title: Re: ML Samplefiles
Post by: Tullen on January 16, 2017, 01:09:49 PM
Hi. I will try to provide some 50d footage the coming days.
Title: Re: ML Samplefiles
Post by: child01 on January 20, 2017, 02:04:09 PM
Hi, Chmee!
I'm that guy who asked you 3 and then another 3 questions)) About "why your tool stays stable neutral". and you've said - put footage into the ml samples thread.
So, here I am.

Problem description:
ML menu MOVIE -> Image Fine-tuning
about this menu - subtle image enhancements via DIGIC register tweaks
So, any changes I make in this menu make zero impact on my footage via RAW2CDNG tool.

I've made a cheesy blockbuster for everyone to enjoy))
starring: ML menus, CDNG, my thumb and why-meme in the final scene  :o


Samples:
All Image Fine-tuning settings are OFF https://yadi.sk/d/ert8oT6A39yxJV
Black level +100 (reddish shadows) https://yadi.sk/d/FIjZuDEO39yydM
ML digital ISO -2 https://yadi.sk/d/QzoLUoYl39yywV
ML digital ISO +1 https://yadi.sk/d/toxt0V7b39yzAw

Lowering ISO below CANON's 100 is a very useful feature!
Making shadows reddish is also nice :D
Shutter fine-tuning - it is hard to overestimate the benefit of this option! (didn't put it into test since it's hard to tell the difference via my youtube blockbuster).

Using magiclantern-crop3x.2017Jan13.5D3113

PLEASE, Chmee, figure it out.
Title: Re: ML Samplefiles
Post by: Magic50D on January 24, 2017, 06:56:30 PM
I've read the request for samples in a 50D thread, so hope i can do something  back.

50D: https://drive.google.com/open?id=0B6X2MuRRVHRdNzJKUl9ZQmlYRjg
magiclantern-manual_lens_info.2017Jan11.50D109
Hacks On
No Crop

If you want me to test another a other build or a 5D2 build, i'm testing a few lenses so it no problem.
I needed i'll post some samples with a higher colour range.
Title: Re: ML Samplefiles
Post by: justinbacle on February 08, 2017, 12:23:58 AM
50D
Build : Nightly.2017Jan14.50D109
http://www.justinbacle.com/temp/M08-0000.MLV (http://www.justinbacle.com/temp/M08-0000.MLV)
(http://www.justinbacle.com/temp/M08-0000_000000.jpg)
Title: Re: ML Samplefiles
Post by: Surin Dmitriy on June 26, 2017, 12:31:06 AM
Some short samples of 10bit, 12bit, 14bit filmed with a 5D mark III

10bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirYUJxZ0JPVzJsX0k/view?usp=sharing

12bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirckp3bFBqanNmbXc/view?usp=sharing

14bit MLV(mlv_lite)
https://drive.google.com/file/d/0B4tCJMlOYfirM1loSU9sYWxHeW8/view?usp=sharing

All of these samples after conversion have the first black frame. I have first good frame when converting original 14 bit mlv (non mlv lite). Does anybody confirm that?
Title: Re: ML Samplefiles
Post by: Danne on June 26, 2017, 10:55:17 AM
I get no black frames. Converting with mlv_dump. How are you processing your files?
Could be an idea to test with later filmed material. These files are from an early version of mlv_lite.