Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Messages - brapodam

#76
General Help Q&A / Re: Timelapse Help
July 01, 2013, 02:44:53 PM
After all my testing, I think that the best way to do it currently is to use Silent Pics in Aperture Priority mode with post-deflicker. Processing will have to be done in Lightroom or ACR for the best possible results (editing DNGs directly rather than output files from ufraw, which lack the flexibility of raw files).

If anyone has a workflow that works (for editing files before post deflicker exposure adjustments) without Lightroom or ACR, do share it  :)

Of course, if your time lapse does not involve any exposure change, the RAW video frame interval mod works pretty good.
#77
General Help Q&A / Script to Edit .UFRAW files
June 28, 2013, 09:15:45 AM
Hi,

I'm still very new to scripting and stuff like that, so I need a little help here. I want to write a bash loop to edit the .UFRAW files from post deflicker to offset the exposure by a fixed amount for every file. This is because sometimes, the exposure changes generated by post deflicker are not optimal (making the image way too bright or way too dark).

Also, is it possible to apply post deflicker after editing (and exporting) files in other image processing software like darktable or RAWTherapee? The RAW DNG files contain so much more dynamic range compared to the tiffs I export from ufraw, and somehow hot/dead pixels aren't recognised in the tiffs too (hot/dead pixel removal works perfect with the DNGs, but ceases to work on anything other than raw files). Workflow for Auto ETTR post deflicker time lapses is quite easy if you have Lightroom because xmp files integrate directly with it, but if you don't, it's a bit tricky.
#78
General Help Q&A / Re: Auto ETTR
June 26, 2013, 10:38:16 AM
Quote from: mSpider on June 26, 2013, 08:36:22 AM
Alright!
I'm very excited to try.
Which nightly build are you using right now?
I'm using one of the hourly builds compiled for RAW video for 60D, here: https://www.dropbox.com/sh/1kitzbmanifb6sf/qgkHzW3gn2
#79
General Help Q&A / Re: Auto ETTR
June 26, 2013, 07:13:40 AM
Quote from: mSpider on June 26, 2013, 07:00:16 AM
"This functionality has not been ported to all of the cameras.  For now the following cameras should have the AutoETTR function but this will have to be confirmed due to the all of the development work going on.  In some cases some features will be disabled to free memory or to trouble shoot specific problems.  So don't expect it to be always cooked into your firmware update.

5D3, 5D2, 6D

For the 650D, 600D, 60D, 50D, and 40D the work is still in progress.  Follow the progress on their own threads to find out if and when will the AutoETTR function will be enabled."

...
I haven't been able to find any mention of the progress made.
Is there anybody with a 60D that has used successfully the new Auto ETTR with the 60D?
I hear it works great on the 5DmIII.  I don't have that body.
I've been having it on my 60D for quite some time already, and it works well.
#80
Quote from: Andy600 on June 23, 2013, 04:16:01 PM
a1ex is probably the best person to help with this but he's not online atm (I think).

Don't panic! Worse things than this have happened on other cameras and been fixed through careful procedures.

It's understandable that you feel anti-ML atm but you are in a tiny minority. Most users never experience these problems and it's possible that the camera itself could have an issue but wait for a1ex.
Yup, I have switched shooting modes in ML menu before but nothing bad happened before. As with any custom firmware or ROMs or whatever, bad things can happen. Bad things happened to my phone before while flashing custom ROMs, many many times, but the devs always managed to troubleshoot the problem and guide me on how to fix it. It should be similar with ML. I've had some minor problems with the camera locking up before but a battery pull always fixed it.
#81
Quote from: Haliburton on June 23, 2013, 01:12:10 AM
It's just a routine I got into with regular film making: switches the view on or off without the slight jiggle that pushing a button, however carefully, can cause. Especially visible when filming with telephoto lenses. Again, I swing the display _almost_ closed: no snap into or out of position.
I don't do normal video, I only ever used video for time lapse purposes. I may venture into normal video in the future, but not for now. For time lapse purposes, you can press the button during the frame interval, so the camera shake during the button press is a non-issue unless your frame interval is very short.

Quote from: Haliburton on June 23, 2013, 01:12:10 AM
So is the ramification of this, that one can film in raw, using still auto exposure modes such as AV, or M with ISO being auto?
I do not recommend using auto ISO. When ISO is auto, gradual exposure does not work, so you will experience flicker in your video. Gradual exposure, however, can change your ISO, so if you are referring to that, then yes, it's sort of an Auto ISO
#82
General Help Q&A / Re: Timelapse Help
June 22, 2013, 10:14:48 AM
Quote from: Haliburton on June 22, 2013, 09:30:41 AM
mmm, lots to chew on, thank you @brapodam!

FWIW, while recording RAW time lapse video, I close the swing-out monitor of my 60D, just far enough that the monitor switches off (not quite closed).

Also using eBay special external power adapters for both the T3i and 60D.
Why do you have to close the screen? I set powersave to the info button, so I just press it when I start recording. If I want to check something, pressing info again wakes the screen.

Quote from: Haliburton on June 22, 2013, 09:30:41 AM
"I believe shooting RAW video in photo modes was disabled in the more recent RAW video builds..."

I was completely unaware of this ability in the first place?

Thanks for the link.

I was not aware of this ability until I saw the changelog. The change was recorded here: https://bitbucket.org/hudson/magic-lantern/commits/5155c8dbe34c8369e8e0dd74e272fa1ab667c6a4

Quote from: Haliburton on June 22, 2013, 09:30:41 AM
In other news, though with my cards formatted ExFAT, I no longer have the 4GB file-size limit, my RAW time lapse sequences still halt recording exactly 1/2 hour from start.

Is that a hard-coded Canon thing, or is there a workaround: anyone know?
I don't know if movie auto restart will help. I've never really tried that since I never really tested long enough sequences to bust the 4GB limit.
#83
General Help Q&A / Re: Auto ETTR and Post Deflicker
June 22, 2013, 10:06:50 AM
Quote from: a1ex on June 22, 2013, 09:39:22 AM
Post some images (DNG + sidecar).
Sure, I've uploaded a couple of random DNGs and their UFRAW sidecars from the test I did. Original DNGs seemed slightly underexposed (I had set Auto ETTR to always on though) already and yet post deflicker does further exposure reduction

https://drive.google.com/folderview?id=0BzFGDdZw7pVwbkN1bFlNMFZ1UXM&usp=sharing
#84
General Help Q&A / Re: Timelapse Help
June 22, 2013, 03:13:47 AM
I was quite interested in ML's capabilities to shoot time lapse sequences without moving the shutter mechanism, and I have done some testing.

H.264 video, FPS override, Video Auto Exposure
-Images were okay, but lacked clarity and dynamic range of RAW video
-Have to have appropriate ND filter
-No flicker

Silent Pics, Auto ETTR, post-deflicker
-Might be an issue with my settings for auto ETTR or post deflicker, but the post deflicker exposure changes made all my images horrendously underexposed, as described here: http://www.magiclantern.fm/forum/index.php?topic=6649.0
-No ability to record with screen off; internals of camera heat up too fast as a result, producing images with a lot of noise
-Recently there has been a change to make powersave more aggressive when shooting silent pics, but if you enable screen off in powersave, the screen will not come on in time for Auto ETTR to change your exposure, rendering it useless.

RAW video, FPS override
-Shutter speed too limited. You'll also need an appropriate ND filter for the light conditions
-Longer intervals results in longer exposures, which can produce more noise
-Has ability to record with screen off

RAW video, Manual ETTR (put it to set and press it every time you see the ETTR hint change), with this mod http://www.magiclantern.fm/forum/index.php?topic=6451.0
-Exposure changes too drastic
-Due to screen not being able to be off for too long, internals of camera heats up, noise becomes a problem even at low ISOs

RAW video with video automatic exposure
-Camera shoots at non-native (pushed/pulled) ISOs, which are useless in RAW video. As a result, exposure changes are drastic (since exposure only really changes once it hits the next base ISO)
-Has ability to record with screen off

RAW video with Aperture Priority mode, Gradual Expo, with this mod: http://www.magiclantern.fm/forum/index.php?topic=6451.0
-Did a short test at home, and flicker seems to be less of a problem. Still visible but it could be because the exposure change I tested was too much (or my Gradual Expo setting needs to be tweaked)
-I believe shooting RAW video in photo modes was disabled in the more recent RAW video builds, but if you use the mod, your raw video module will be the old one
-Has ability to record with screen off
-EDIT: After further testing, this still produces flicker. Less noticeable, but there still is flicker. There might be a possibility of tweaking the mod further to increase compatibility with gradual expo.

Silent Pics, Post Deflicker, Aperture Priority Mode
-Again, could be my settings for post deflicker, but it seems to choose exposure offsets that make the images way underexposed
-If you don't use Lightroom, it becomes extremely challenging to do anything (see below)
---As far as I know, there is no way to do image adjustments on the DNG files directly before post deflicker
---This means you'll be doing image adjustments on the output from ufraw-batch, which have limited dynamic range compared to DNG files
---Many image operations just don't work as well if you're not editing raw files. At least for me, things like noise reduction produce crap results compared to raw/dng files; they become either too soft or you don't remove enough noise
#85
General Help Q&A / Auto ETTR and Post Deflicker
June 20, 2013, 02:56:42 AM
How do I do it properly? I tried it one day for a sunset time lapse, but post deflicker decided to decrease the exposure so much that everything became underexposed. If anyone's interested, here's a tiff file exported by ufraw (no edits, only the exposure change from post deflicker). https://docs.google.com/file/d/0BzFGDdZw7pVwcDRaWWpsQXhwOTA/edit?usp=sharing It's the first frame of the entire time lapse sequence, shot about 20 minutes before sunset time.

Is it that the post deflicker target was too low? I had it at the default of -4EV (I think the first frame was about -2EV)

Or should I use a higher percentage highlight ignore in Auto ETTR because my shot included a lot of the sky?

Anyone?? I'm pretty sure the combination of Auto ETTR and post deflicker is not supposed to produce such massively underexposed images.
#86
General Help Q&A / Re: Timelaps Question
June 19, 2013, 04:07:18 AM
You can use silent pics with auto ettr and post deflicker. However I don't really know how to use it properly. When I use it, post deflicker drops the exposure too much and that drops all the shadow detail. Also, the recent changes to make powersave more aggressive when using silent pics breaks auto ettr since the screen does not wake in time to give auto ettr enough time to adjust exposure. This means you have to disable screen off in powersave, which, for time lapse, heats up the camera very quickly, resulting in a very noisy image.

You can try using this raw video mod http://www.magiclantern.fm/forum/index.php?topic=6451.0 with auto video exposure. I haven't tried it, but I've tried auto video exposure with H.264 video for time lapse (with fps override), and it works well exposure wise, with no visible flicker.
#87
Raw Video / Re: 60D RAW video - it's working !!!
June 18, 2013, 06:23:39 AM
Quote from: kingskafa on June 18, 2013, 05:54:06 AM
Hello friends!
I have been stalking this forum for awhile.
I used an older ML build from the 8th I think.. but this new 60D one
https://docs.google.com/file/d/0B-HdscXfsKpgY1J4b1MyLUxzMFU/edit
keeps saying that the magic.sym is missing when loaded onto my camera.   Every time I download it, it downloads as a .txt  I change it to just .sym but it stays a .txt file    I try to use an older magic.sym... still no good
Any ideas?
Try the builds from here:
https://www.dropbox.com/sh/1kitzbmanifb6sf/qgkHzW3gn2
#89
Raw Video / Re: 60D RAW video - it's working !!!
June 16, 2013, 12:47:51 PM
Quote from: marekk on June 16, 2013, 12:33:14 PM
simply rename magic.sym to 60D_111.sym.

Here is a fresh build with ETTR module:
https://docs.google.com/file/d/0B-HdscXfsKpgc0NmSmtmZU9ENUE/edit?usp=sharing
Not sure if you meant it to be that way, but it says I need to request access (which I have done, but wouldn't it be more useful to set it such that anyone who has the link can access it?)
#90
Raw Video / Re: 60D RAW video - it's working !!!
June 16, 2013, 11:49:34 AM
Quote from: marekk on June 16, 2013, 11:32:02 AM
Ettr module is not included in rocket's autobuild, I've just send him a message to add it to autobuild
Oh, ok thanks. I was wondering where it went.

By the way, the latest build (ML-RAW-60D-hourly_2013-06-16_09-20.zip) still has the missing symbol file issue. Any idea what is the issue there? Is there supposed to be a "B:/ML/MODULES/60D_111.sym" file but it's not included in the autocompiled builds or is it not even supposed to exist?
#91
Feature Requests / Re: Shutter Speed Compensation
June 16, 2013, 10:35:23 AM
Quote from: lamella on June 16, 2013, 10:29:05 AM
Thank you for your comment. I think ETTR is a powerful help to lower the noise, especially in shadows, but the shutter-speed-compensation is another thing.

Suppose you shoot a far away house with a telephoto lens like 200mm/2.8. The automatic metering calculates that you need 1/200s exp time and aperture 2.8 on ISO100 to have a well exposed image. But the subject is not flat, so you want deeper depth of field, which means higher aperture like 8.0. Since you have IS on the lens, you know the shot can be taken with 1/25s 8.0 ISO100. But the automatic metering does not allow that for you:

- If you switch to Av mode and set 8.0, the automatic metering sets shutter speed to 1/200 but ISO800 =>  unnecessary big noise.

- If you switch to Tv mode and set 1/25s, the aperture remains 2.8 and ISO 100 => you don't have more depth of field.

- If you switch to M mode and set 1/25s and aperture 8.0, the ISO stays at 100 because there is enough light, but you had to do the math, automatic metering helped nothing. And if you change the focal length (if it's a zoom) to eg. 70mm, you have to do the math again.
And this is the annoying part: automatic metering does the math well but lucks an important parameter: how stable is the lens, what is the lowest exposure time allowed to take an sharp picture.

This is where the shutter-speed-compensation parameter comes in: if I could set it to 3 EV that means for the calculator: OK I know the lens has focal length 200mm, but it can be handled as a 25mm lens! Because the hand movements does not shake it so much, thanks to the IS.

So my question in other words, would it be possible to mock the automatic metering with a focal length changed with a given factor? If I have IS I would set it to 3 EV, and if I put the camera in my grandfather hand :), I would set it to -2 EV. (The latter means: the lens should be used as if it's a longer lens (800mm), shaking much more than we think.)
-Auto ETTR does not change aperture, it only modifies ISO and shutter speed
-You can select "link to Canon shutter' in the advanced options for Auto ETTR, so you can use the scroll wheel to change the minimum shutter speed allowed for ETTR on the fly

With these 2 points, I think Auto ETTR satisfies your needs. Of course Auto ETTR isn't perfect because it has to have either live view on or you'll have to shoot at least 2 shots to get the correct exposure.
#92
Raw Video / Re: 60D RAW video - it's working !!!
June 16, 2013, 10:19:45 AM
Quote from: form China on June 15, 2013, 01:55:15 PM
Hey guys!

When I was using the these version:06-14_19-20.zip   —    06-15_10-40.zip
They all have the same error :(
RAW not loaded,
Error loading  'B:/ML/MODULES/60D_111.sym': File dose not exist


How do I solve this problem

many thanks!
Same here, and it also seems that Auto ETTR was dropped or something. I don't see it any more.
#93
Quote from: EOS4K on June 16, 2013, 07:39:32 AM
Is it possible to record 4K video at 1fps using the new Magic Lantern RAW video hack? Wouldn't 1fps eliminate the need to sacrifice resolution (due to limited data transfer speeds) in RAW video mode?

Is there a reason this sample video was shot at 1872x1250 and not 2048x1080 or 3840x2160?


Thanks!
I think they pull the RAW image from the live view buffer or something (at least that's how the 14 bit DNG silent pics work), so the max we can get is the live view resolution, which depends on your camera.
#94
Raw Video Postprocessing / Re: raw2exr in Linux
June 15, 2013, 03:59:45 PM
Do you absolutely have to import every frame? I notice darktable has a tendency to crash if you import too many photos. If you only need to import a couple frames to preview adjustments, I suggest creating a separate folder and storing a couple of frames inside, and importing them into darktable to edit. After which you can use darktable-cli to export everything based on one xmp file. I don't know about normal video, but this is what I do when I try RAW video time lapses. I just bring in the first and last frame (stored in a subfolder) into darktable, do my adjustments, copy the xmp file into the main folder, and run the bash loop in the main folder:


i=0
for file in *.dng; do
  output=$(printf "exported/%06d.jpg" ${i})
  darktable-cli "${file}" "000000.dng.xmp" "${output}"
  let i++
done

Basically exports everything based on the xmp file of the first frame into a subfolder called exported. You can just change the jpg extension to exr, and the output filename to whatever you want.
#95
Feature Requests / Re: Auto ETTR during recording
June 15, 2013, 08:47:06 AM
Quote from: Audionut on June 15, 2013, 08:29:22 AM
Silent pic does take a bit to process.  So yes, very small intervals will not keep up.

Forget about Canon powersave stuff.  ML powersave will be the best you can get.  The screen needs to be activated for the time silent pics does it's process.  So you can shut the LCD off, but it needs to activate again for silent pics.

You can't put the camera into full powersave (sleep) mode.  It obviously needs to be awake to do stuff!

AutoETTR needs the LV active to work.  So even if AutoETTR gets enabled with raw video, the LCD must remain active.

The only current advantages I see for using raw video for an intervalometer is that you can have very short intervals, and the LCD can remain fully deactivated.  The cons are increased processing time and currently a lack of deflicker options.

IMO, raw video and intervalometer are 2 different tasks.  Raw video shouldn't be hacked to provide the features of an intervalometer.  If the intervalomter is lacking, it should be improved.

Intervalometer is not lacking, silent pics is. With the current implementation of silent pics, it doesn't offer any advantage over RAW video. It is, in fact, an inferior RAW video.

As for LCD screen on for Auto ETTR to work, if it has to be done, then I'll do it. Because that is still not a disadvantage over silent pics, since silent pics require LCD to be on anyway (unless your intervals are long enough).

Either way, would memory hack not be enough for Auto ETTR to work? I don't quite understand how it all works, but I always assumed that RAW video is something like an extension of silent pics, where the camera captures the footage from the live view buffer. If memory hack can enable the LCD to be off (I'm assuming here that live view is technically still active, just that it is not displayed to the LCD) while recording, then it should also be able to make Auto ETTR work with the screen off.
#96
Feature Requests / Re: Auto ETTR during recording
June 15, 2013, 08:03:59 AM
Quote from: Audionut on June 14, 2013, 05:46:26 PM
How many revisions ago?  As I mentioned, it was all working fine here.
I don't know exactly how many revisions back. I just did a quick test today with the build from June 13 and here are the results:

-With an interval of 1s set in the intervalometer, the silent pics do not keep up.
-With an interval of 5s set in the intervalometer, the intervals seem normal
-Activating powersave manually will put the camera into powersave provided it is not currently capturing or saving a silent pic (I've set it to shut off LCD and globaldraw off), but camera wakes at the next silent pic
-Waiting for powersave to come on automatically does not work (camera does not enter powersave automatically - I've set it to activate at 30s). Maybe the powersave activation time has to be lower than the intervals between the silent pics
#97
Feature Requests / Re: Auto ETTR during recording
June 14, 2013, 05:38:09 PM
Quote from: Audionut on June 14, 2013, 04:52:20 PM
Intervalometer+powersave+silent pic+AutoETTR (always on) in photo mode LV is working fine here on a 5D3.

Didn't test the 1000 shot theory, but you seem to imply that won't be a problem for you anyway.

Be handy to have the deflicker sidecar file saved with silent pic.  I kill my shutter enough as it is without playing with timelapses.
Last time I checked, the moment powersave activated, capture of silent pics stop. Also, as I have mentioned before, the intervals do not work properly for me (I tested in M mode, so it should be the same as what you tested (photo mode LV))

I think with dhilung's frame skipping mod (http://www.magiclantern.fm/forum/index.php?topic=6451.0), and auto ettr during recording, RAW video for time lapse will become very viable (it's already pretty good now for scenes where exposure doesn't change much). I think this is all about using less shutter actuations. Intervalometer with normal RAW files are still better, but I think soon enough, RAW video will close the gap.
#98
Feature Requests / Auto ETTR during recording
June 14, 2013, 01:26:31 PM
Mainly useful for time lapse recording using raw video. Is this something that will be considered?

Before the suggestions on using RAW DNG silent pics instead pour in, I've found a few problems while using it:
-Interval between shots are slower than the interval set in intervalometer, at least for the intervals that I've tested. Makes it very unpredictable to use
-No recording while screen off (available in RAW video with memory hack)
-Offers no advantage in terms of deflickering compared to RAW video, since it doesn't write the XMP files
-Limit of 1000 shots (as reported by others, I've never exceeded 1000 shots in any time lapse)

I also have no idea how to do picoC scripting, but if anyone can point me in the right direction on how to make a script to trigger Auto ETTR at fixed intervals, that would be fine as well
#99
Quote from: JoshuOne on June 13, 2013, 04:57:35 PM
Honestly, a1ex, I do not know any reason not to just use the intervalometer and silent pics, I shot a little test just now to make sure it really was that simple and sure enough it seemed to be. I do think that I was given a limit on the number of frames, and if they are considerably less than those available with this module, that could be a reason. As it is, the straight DNGs from silent pics are missing the white stripe and are one less post-pro step from greatness! Thanks for the suggestion.
~JoshuOne
I just tested silent pics again today and from what I can tell, it doesn't keep up with the interval I set it to (1s). It may work for longer intervals, but it seems more like 2-3s between each picture from my quick test. This is strange because RAW video has no issues whatsoever doing 1fps video, apart from the 4GB limit, which you can just use the auto restart video feature (In timelapse, it doesn't matter if you miss a few seconds of frames, because depending on your interval, you may lose just 1 or 2 frames, which is not a big deal).

Honestly speaking, converting RAW to DNG doesn't take that long, so if we have this change implemented, I think we can do away with silent pics altogether. Last I checked, silent pics with intervalometer don't generate the post-deflicker XMP or UFRAW files anyway, so I don't see them being more useful than RAW video with this small change.

Also, after a quick test, I did not see the white stripe at the bottom that you described. I'm using the 60D though, so it could be different.

I think this would be most useful if Auto ETTR could work while recording too. I could not get it to work while recording; Auto ETTR only sets the exposure before recording despite setting it to always on (or am I doing something wrong?). It can work manually if you put it to set and press set while recording, but that's dumb because you'll have to repeatedly press set while recording, which is not an option for time lapse videos.
#100
Quote from: a1ex on June 13, 2013, 04:14:52 PM
Why not just enable the intervalometer and silent pics? You get DNGs straight from the camera.
I'm not sure if it's changed now, but the last time I tried it, silent pics came out really soft (even softer than H264 video), with a purplish tint (could be because I screwed the white balance, though it was on auto so I don't see how this could happen), with no ability to shoot with the screen off, and with some frames having issues like having a purple box at the bottom. Also it doesn't seem to shoot at the rate that I set the intervalometer to (it seems a lot slower - setting it to 1s interval resulted in something like 3s interval between pics)

Again, it could have changed since the last time I tested it, so I'm not sure if it has all these issues.