Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Messages - apefos

#51
Here it is a RAW dual iso video recorded by the 600D T3i for download. I uploaded it because it gives me lots of magenta dots and can be used for reproduce the problem and improve the CR2HDR-HOT (drag and drop over the cr2hdr-hot to reproduce the dots in dng sequence)

http://www.apefos.com/dualiso/di600d.rar
#52
Feature Requests / Re: dual ISO H.264
November 21, 2013, 06:38:13 PM
Ok, let's forget about one line per iso...

Can I just ask for enable the dual iso recording in h264? (just enable and keep the two lines per iso)

a1ex told me he would enable it after my homework, and I did the homework in photo and video...

Quote from: a1ex on November 17, 2013, 01:00:24 AM
@apefos: please do your homework first. After you will get reasonably good results, post them and I'll enable it for video.

thanks!
#53
Raw Video Postprocessing / Re: PinkDotRemover tool 650D
November 21, 2013, 04:58:59 PM
download this, it is a free (old) plugin, but it can inspire you...

http://www.apefos.com/dualiso/svpr.rar
#54
Feature Requests / Re: dual ISO H.264
November 21, 2013, 04:55:53 PM
ok, guys, I give up! I learned something in my life: "I agree that we disagree" (about the need of testing it). I was just hoping and wondering that h264 could be different from raw and could handle one line per iso with the internal camera debayer algorithm, maybe someday I learn to compile...
#55
Feature Requests / Re: dual ISO H.264
November 21, 2013, 01:29:25 PM
#56
Long time ago I found a plugin for dealing with hotpixels, it is free, no longer available, but I will allow a link for downloading it because maybe the developers can get inspired on it to find a solution for the issue:

http://www.apefos.com/dualiso/svpr.rar

I did a test in the cr2hdr-hot.exe and ir deduces the size of the hot pixels, but do not remove them completely, see the difference between the results from cr2hdr and cr2hdr-hot:





#57
Feature Requests / Re: dual ISO H.264
November 21, 2013, 09:25:15 AM
I think the external recorder can be good idea to allow less compression in recorded video and a cleaner result, but for the low budget people the main goal is to record in h264 in the memory card. After doing the test in the video, I believe the h264 recording will be fine to retain the lines. But first, the main challenge is to test if the camera debayer algorithm can reconstruct the image when using one line per iso, and send a good even/odd fields with the different isos in a reconstructed image  to h264 recording or to the external recorder. I believe yes, but it needs real world tests.
#58
Today I finished my first tests with dual iso raw video with 600D T3i. I learned the workflow and I got good images.

Problem is: magenta dots everywhere.



Reading the forum I found many people have this issue, so I have a few questions:

Is there one or more Canon DLSR cameras which can do dual iso raw video without any dots? (i am interested only in video)

Is there a good working solution for the dots in the 600D T3i? (and/or for the other cameras)

Thanks!
#59
Feature Requests / Re: dual ISO H.264
November 21, 2013, 01:01:22 AM
I did more tests and in 1280x720 raw recording in dual iso the waterfalling problem did not happen yet. Sometimes it happens in 1728x992 and in 960x544, It seems to be an intermittent problem, it comes and goes...

For Raw dual iso, as said in previous post, the merging algorithm can deal with this issue, but if h264 dual iso will be implemented this bug needs to be fixed for computer deinterlace and interpolation, or a special extracting program needs to be created.

For RAW recording I understood the need of two lines per iso, the two lines combo will have the red, green and blue information to allow the image reconstruction for each iso.

But for h264 dual iso, probably the camera debayer algorithm can reconstruct the image using just one line per iso, because this is the nature of the camera debayer algorithm, it uses the surrounding pixels to reconstruct each pixel from the bayer pattern. In the interlaced footage from camcorders with 1920x1080 pixels sensors the even and ood fields differs a lot from each other in moving images and the camera can reconstruct it and no problem. also there are lots of light changes in images and the camera debayer algorithm always do a great job. just remember the canon hv20 camcorder. it is a 1920x1080 sensor and records 24p and 60i pretty good, no moire and no aliasing.

These are the reasons I strongly encourage the developers to try one line per iso in dual iso h264 recording. maybe it can surprise us with great results. and the workflow is easy to do in batch processing in computer. the video I did proves the lines separation can be retained.

if we can get two images with 1920x540 for each iso, the interpolation will be pretty good, and the hdr video will shine. there is also the instant hd and blow up plugins whic can do this interpolation without aliasing. if one line per iso in dual iso h264 works it will be revolutionary... no need lots of cards, the inexpensive Rebels will do it at 1920x1080, sound in camera... very small or no aliasing...

I do not know how to compile and it is hard for me to learn... I hope the devs give it a try...

sorry for lots of talk about this feature, but it is very promissing and I am really interested on it

thanks!

#60
Feature Requests / Re: dual ISO H.264
November 20, 2013, 03:22:43 AM
thanks!

the dcraw and the exif are in the same folder of cr2hrd now. it works, but there is a line which says:

black subtract didn't work

and the reconstructed images are underexposed, see the text: (I found this: "After postprocessing, you will get a DNG that looks like a dark ISO 100 shot, but you can bring the exposure back up and be delighted by how little noise is present in those recovered shadows.") so it seems to be working, but there are lots of magenta or cian hot pixels...

#61
Feature Requests / Re: dual ISO H.264
November 20, 2013, 01:39:00 AM
Interesting, so it is safe for RAW recording! But for H264 recording maybe it could be a problem because it changes the lines position for deinterlace...

It seems I found another bug, I did some try to drag the DNG sequence over the CR2HDR but I got this screen and nothing happens... (using 600D T3i) see:

#62
Feature Requests / Re: dual ISO H.264
November 20, 2013, 12:57:38 AM
It seems I found a bug in dual iso. Sometimes in 600D T3i in 1728x992 and in 960x544 the recorded RAW video in Dual Iso shows moving lines. the lines scroll down, I called it waterfalling behavior. See the video: (password = diwfb)

#63
Feature Requests / Re: dual ISO H.264
November 19, 2013, 12:20:12 AM
Are you playing the devil's advocate? or you just do not have the inovative spirit? The inovative spirit does not listen to the impossible, it prefers to fail doing it, because doing it allow a chance for success or to learn another way to reach the success. you need to watch the JOB movie to try to implement some inovative spirit on you.

I still believe one line per iso is possible because the camera algorithm uses the surrounding pixels to reconstruct the hole image. in raw the one line per iso could be a different history, but for h264 we have a chance: maybe the camera debayer algotihm can reconstruct the rgb data for all the pixels and all the image even with one line per iso, let's give a try to the camera debayer algorithm using one line per iso. if it fails we just need to go back for two lines per iso, it is so simple to try...

I just do not understand why people keep saying "impossible, impossible" without just giving it a try... just trusting in theory. somethimes teory can be surpassed, I believe the camera debayer algorithm can surpass this teory. If you want do to something you just need to close your eyes and ears to people who say impossible, it is better to fail trying to do... nobody will die doing this... and the cameras will not explode...

Unfortunately I do not know how to compile and do not have time to learn. I did what I could, now it is up to the developers to implement it and allow us to test. I think it deserves a try in one line per iso and in two lines per iso.

I will stop posting for a while... I have work to do here and I think it is also time for stop talking and allow  the developers to work on it.
#64
Feature Requests / Re: dual ISO H.264
November 18, 2013, 08:45:03 PM
different opinons and suppositions are normal... mainly when things are not proven yet in the real world... I am the kind of person that does not give up until I see things proven in the real world tests, no matter what people says. we are not loosing anything doing this... and we are loosing more time talking than testing...

the interlaced footage 60i and 50i from dslr and camcorders uses one line per filed and it works. why the one iso per line would not work? it is the same principle. let's see how the camera will demosaic and debayer the sensor with one line per iso, we cannot say things before seeing it...

using deinterlace+interpolation in one line per iso video will turn 1920x1080 into 1920x540 for each iso and it will interpolate pretty well. if we use two lines we would need a special software for deintercale images considering two lines to avoid the 50% downscale. But the best will be to see what happens recording one line per iso before to worry about how to deinterlace two lines per iso images...

@a1ex , @1% , I did the home work, and i did pretty well, so can you enable the h264 recording in the dual iso module and also enable two versions, one version with two lines per iso and other version with one line per iso? this way I can test it and we will se the real world results. you can create these two modules separated from the module for raw (dual_iso_h264_oneline.mo and dual_iso_h264_twolines.mo) it deserves a try, only a real world test will give us the real results, all talking is just suppositions, we need to see what happens in the camera and in the computer.

if you preffer I can do the tests in private videos and not share the module, send me a pm, or I can do it public if there is no problem.

thanks
#65
Feature Requests / Re: dual ISO H.264
November 18, 2013, 06:44:28 PM
Yes, I did a read in the dual iso pdf right now

It says exactly what I was guessing in my previos post, dual iso uses two lines to get red and blue information for each iso considering the bayer patern desing: line1= RGRGRG, line2=GBGBGB

The pdf paper does not say one line per iso is impossible, it just say: "good luck interpolating them" and I would like to try my luck!

For h264 recording the camera will do the debayer process before encoding to H264, so we have a chance for the one line per iso to work. The interlaced television video uses one line per field, so one line separation is possible. also in the tests I did in the video above proves that H264 and JPG can retain information in one line per iso.

As I said in the video, we can work in a second dual iso module designed for h264 and leave the current dual iso module just for raw, this way we will not disturb the raw recording in dual iso, we will develop a second experimental and independent module for h264 (dual_iso_raw.mo & dual_iso_h264.mo)

if one line per iso works it will be just great, if it does not work all we need to do is to go back to two lines per iso. why not to try? let's do a test in a module specific for h264 with one line separation and see what happens...

"I want to believe."

#66
Feature Requests / Re: dual ISO H.264
November 17, 2013, 09:51:33 PM
password: diuhjc

#67
Feature Requests / Re: dual ISO H.264
November 17, 2013, 01:12:13 PM
Let's go on...

I took a look in the Large Fine JPG in the computer and yes, each iso uses TWO lines. So this is impossible to separate using deinterlace... So I did a 50% resize in the image (downscale) to discard half of the lines and the image changed to ONE line per iso as was expected and the deinterlace+interpolation works...

about video: I recorded a RAW video in the 600D using 1728x992 @ 8 fps with dual iso enabled. The DNG sequence in the timeline shows TWO lines per iso, so it will need a downscale to 50% size to make deinterlace works. I can render the DNG sequence into a H264 video file, and then export a jpg sequence from it  to test if the compression will retain the lines separation, but before it I have a question:

why using two lines per iso instead of just one in the dual iso video? this would make sense for interlaced footage, but for progressive footage one line per iso would be enough... maybe the reason is to respect the bayer pattern? because bayer pattern is GRGRGR and next line is BGBGBGBG. is this the reason or the reason is just to get a better separation? Maybe in the dual iso h264 video we can use one line per iso because the h264 video is debayered in camera just like the jpg images are... one line per iso would introduce less aliasing in the final result and no need a 50% downscale before doing the deinterlace... share your thoughts...

about color cast in sub-images: it is normal issue due to when you change brightness the perceive of saturation changes. The saturation level is the same in the two sub-images, but less brightness makes the eye to feel there is more saturation and more brightness in the other image makes the eye to perceive there is less saturation. But saturation level is the same and things become ok in the merged image. The look of the low brightness image tends to me more red and the look of the high brightness image tends to be more green, but in the merged image everything becomes ok. No need to worry about this for the h264 dual iso video, after merging the final result will be ok. If a merged preview could be enabled in camera probably it would be ok also...

if a merged preview could be enabled in camera maybe the camera could record it into a h264 video!!! but there will be enough processing power to do it in 1920x1080 @24fps ? And using two lines per iso a 50% downscale would be a must before deinterlace+interpolate+merge, but using one line per iso would not need the 50% downscale... or another algorithm for deinterlace would be needed, probably the implemented deinterlace method in the CR2HDR.exe is already doing the deinterlace for two lines per iso or is it doing a 50% downscale?...

More about preview in camera: when looking at the dual iso in live view, I perceived that the high iso prevails over the low iso image, maybe due to more light on it, and I cannot judge the exposure for the low iso. I need to disable the dual iso module to see each iso and find the better iso combination before enablind the dual iso for recording. this way I can get great exposue for the low and high iso lines, it is impossible to set the exposure with dual iso enabled. Also, the white balance in raw recording is wrong at the moment of recording, colors need to be tweaked in ACR when importing the DNG sequence to timeline. Maybe the color cast in dual iso preview is just because the raw recording cannot show correct colors in live view, I always see some magenta cast when previewing dual iso in the lcd. I think this is not a big problem, I can deal with it.
#68
Feature Requests / Re: dual ISO H.264
November 17, 2013, 07:13:00 AM
I have good news. It works!

I took a picture in JPG Small Fine with dual iso and raw rec modules enabled, Pic Quality was set to Small Fine.

I deinterlaced and interpolated the same jpg file two times, one for iso 100 and one for iso 800 and then I merged it with enfuse gui in default settings. To separate the isos you just need to choose even or odd field in the deinterlace moment.

the workflow for video will be simple, export an image sequence from the mov h264 file, deinterlace and interpolate each image two times, one for low iso and one for high iso, enfuse each pair with enfuse gui. (all can be done in batch processing)

Probably a simple filter can be created for Virtual Dub to do this task.

see the original dual iso jpg, the two isos deinterlaced and interpolated jpg and the enfused result jpg: (can I try it in h264 video?) thanks!










#69
Feature Requests / Re: dual ISO H.264
November 17, 2013, 01:18:45 AM
@a1ex: I think now I understood the message, now I am doing the homework! Thanks.

I did a try now with the 600D with dual iso module enabled and raw rec 1728x992 enabled and I can shoot a JPG large fine in dual iso and the photo retains the lines... great! I just changed the Pic Quality to Large Fine only to allow camera to save the jpg to the card.

now it is night here, so tomorrow morning I will shoot some jpg photos to do a better perceive in the lines retention and upload to show the results.

Tomorrow I can also try to separate the two fields in the jpg photo using a software in computer, interpolate the lines and merge with enfuse to see what happens...
#70
Feature Requests / how can i do this change?
November 16, 2013, 07:49:09 PM
i do not know if this is in the dual iso module or in the autoexec.bin... i would like to do this change to enable dual iso recording in h264 for the 600d/t3i, how can I open the file, change and save? see:

go to line ~322

change:
int raw_mv = mv && lv && raw_lv_is_enabled();

to:
int raw_mv = mv && lv //&& raw_lv_is_enabled();
#71
Feature Requests / Re: dual ISO H.264
November 16, 2013, 09:20:18 AM
Hi 1%,

It seems to be so easy to modify the dual iso module to allow h264 recording... problem is I do not know how to edit these files. Could you please do this change and allow us to download the dual iso module for h264 from your bitbucket? I have the 600D/T3i running your NewMem build so I can test it.

Many thanks!
#72
Tragic Lantern / Re: 600D/T3i Raw Video
November 15, 2013, 09:45:21 PM
Hi 1%,

please take a look at this topic: http://www.magiclantern.fm/forum/index.php?topic=9145.0

we are talking about the possibility of using dual iso in h264 mov instead of raw, we know the compression can husrt the idea, but it deserves a try... 60i and 50i with even and odd fields video are recorded in avchd in camcorders and works ok...

if you can enable dual iso module to work in h264 mov recording I can help testing it in 600d/t3i

thanks
#73
Feature Requests / Re: dual ISO H.264
November 15, 2013, 09:33:24 PM
If interlaced video (60i and 50i) can be recorded by camcorders and consumer cameras in 17Mbps it is because the lines separation can be retained... if we use 1.3x CBR maybe it will be enough to keep the lines separation in a enough result, if this can shoot in 1080p and interpolated and merged in post and then downscaled to 720p or even to 640x360p for smartphone view it will be great,

Many thanks for testing the idea... If it can give an average result will help lots of people... no need to be 100% perfect...

If you need a beta tester just allow me to download a version of dual iso module enabled to work in h264... I can test in 600D/t3i

thanks and good luck in the tests!!!
#74
1080p 50p/60p would be great for HDR video, because we could get two 25p/30p streams and the shadows would not suffer from optical flow issues... just the highlights would need optical flow. The great dynamic range in 1080p!

nikon, panasonic and sony already have 1080p 50p/60p in their dslr cameras, and Canon already have some powershoot cameras with the new digic 6 processor and 1080p 50p/60p video, so maybe the next Rebel 750d will have this amazing feature...

I know I can do hdr video in 720p 50p/60p, but aliasing is realy bad in canon low budget 720p dslr, so I am hoping for the 1080p 50p/60p in future canon low budget dslr cameras... Maybe in 750D next year?... fingers crossed!...
#75
Feature Requests / Re: dual ISO H.264
November 13, 2013, 06:29:48 PM
So maybe someday the manufacturers or ml will give us two H264 or H265 streams from adjacent pixels in the sensor recorded to the SD card simultaneously, so we can do the hdr merging in the post production.

Or these two streams could be in just one recorded file in top/bottom or side by side, just like 3d...

Also, if the next generation Canon dslr come with digic6 and 1080p 50p 60p, the hdr video with alternate iso in subsequent frames will be better to use, recording h264 or mp4 in 1080p 50p or 60p to get the 25p or 30p overexposed frames (shadows) without optical flow, this would be enough for good quality low movement images, 16 fstops dr, 11 from the custom picture style + 5 from the hdr video...

in narrative or documentary 1080p raw video is difficult for me to use due to the files are so large and no sound in camera...