Magic Lantern Forum

Using Magic Lantern => Raw Video => Topic started by: g3gg0 on May 14, 2013, 11:44:37 AM

Title: RAW Video Module raw_rec [Compiling/Installation]
Post by: g3gg0 on May 14, 2013, 11:44:37 AM
Please ask questions about how to compile or install the raw_rec module here.

Keywords: raw_rec, 14-bit raw, dng, video, module, installation


All questions regarding RAW VIDEO POST PROCESSING on any OS
HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0

All questions regarding RAW_REC MODULE COMPILATION/INSTALLATION/USAGE
HERE
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: scrax on May 14, 2013, 11:50:30 AM
What camera are supported in the source so far?
for what I understood only 5DmkIII or also 5DmkII?
other model like 6D are supported in 1% fork, right?

what about 600D, 60D, 7D and others?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: ted ramasola on May 14, 2013, 11:53:26 AM
I use the MKII and If I need the raw video capability via raw_rec module there is no need to use the May 14 build right?
Since it doesnt have the M tab in the menu when i installed it.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: mucher on May 14, 2013, 12:17:42 PM
For me, it is seemingly the write process uses DMA bypassing the CPU, so any EOS should be able to do that RAW "Video" shooting regardless of the CPU speed, so long as  the CF/SD card supports the writing speed. So I wish one day that I can see this raw video feature appear on 7D. Cannot use picture style is a disappointment but the stunning details and high DR making the pictures looking very real, so it is worth it to go that extra mile I guess.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: g3gg0 on May 14, 2013, 12:33:25 PM
For me, it is seemingly the write process uses DMA bypassing the CPU, so any EOS should be able to do that RAW "Video" shooting regardless of the CPU speed, so long as  the CF/SD card supports the writing speed. So I wish one day that I can see this raw video feature appear on 7D. Cannot use picture style is a disappointment but the stunning details and high DR making the pictures looking very real, so it is worth it to go that extra mile I guess.

7D: working on it, but it seems the interesting part is being handled on master digic that is harder to access (only via FIR)
picture style: *not* needed, apply your corrections on computer - you get the RAW sensor data. (this is post processing)
if you want to discuss about post processing:
> All questions regarding RAW VIDEO POST PROCESSING on any OS
> HERE: http://www.magiclantern.fm/forum/index.php?topic=5404.0
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: arrinkiiii on May 14, 2013, 01:28:16 PM
7D: working on it, but it seems the interesting part is being handled on master digic that is harder to access (only via FIR)

Serious? 7D is in the way? Unbeliveble =DD !!!

Every time that the 7D goes to the "knife" it's always more dificut because of the 2 processors =(( hope that you figure out the raw for the 7D ...and of course the "no need" to upload everytime the ML soft. 7D users for sure that are wating for this long time, i am =DD

Thank you g3gg0, thank you for not forgoting us, the 7D users  ;D

 



Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: g3gg0 on May 14, 2013, 01:32:33 PM
i am not that optimistic that there will be a quick solution :(
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: coutts on May 14, 2013, 01:35:13 PM
5D2 is working now, fyi.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: arrinkiiii on May 14, 2013, 01:39:23 PM
i am not that optimistic that there will be a quick solution :(

Damn  :-[

7D always going have this problem, its always the last and never have all the functions that the rest of the D's have... even the litle "load everytime the ML"   ...it's sad  :'(   it's sad that only you touch in the 7D, but i inderstand...

Great job that you are making in the 5D with the raw, congratulations =DDD Keep the good work  :D
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: ted ramasola on May 14, 2013, 01:42:38 PM
5D2 is working now, fyi.

Thanks for the link to a 5d2 module you gave earlier Coutts. After that link you posted a new nightly build(may 14) was posted, I believed it would have included the module you made for the 5d2 since i read the changelog that it mentioned your stubs.

However it wont show the M tab. So I will still overwrite the autoexec.bin from the link you posted earlier.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: vertigopix on May 14, 2013, 01:56:01 PM
Hi G3gg0,

Any chance for the 60D ?

Anyway, congrats to the team for this crazy good new !
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Tommy.Johansen. on May 14, 2013, 02:11:31 PM
Hi

i install the Nightly build 14 on my 5D mark II but i can find the  "M" tab all of you is talking about .. I'm a bit noob to this soft ware so any help i bet happy for!!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: cinema5D on May 14, 2013, 02:21:12 PM
Guys, this is AMAZING work, truly.
Thanks so much for putting this together for everyone involved, it's revolutionary for the film world.

At cinema5D we put together a small GUIDE covering the basic steps to get the 5D recording RAW: http://c5d.at/1o4
Please give us feedback if anything in there is wrong or easier to achieve and we will update the guide.

Thanks and good light!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: KahL on May 14, 2013, 02:41:21 PM
What's going on w/ the 600D? Is it available to test and where?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: mburgst on May 14, 2013, 02:59:28 PM
Damn  :-[

7D always going have this problem, its always the last and never have all the functions that the rest of the D's have... even the litle "load everytime the ML"   ...it's sad  :'(   it's sad that only you touch in the 7D, but i inderstand...

Great job that you are making in the 5D with the raw, congratulations =DDD Keep the good work  :D

it's like a big faceplam that it's always this darn dual-digic thing that hinds the work on the 7D.

thumbs up for the great work, but for us 7D users that's pretty disappointing after all. :(
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 14, 2013, 03:03:18 PM
I want to know if anyone has been able to compile ML raw_rec module using windows 7 32 bits with Cygwin and gcc 4.7.3


Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: jordancolburn on May 14, 2013, 03:11:46 PM
What's going on w/ the 600D? Is it available to test and where?
The forum user 1% has put together a compiled build for the 600d here (be warned that the SD card limits you to smaller than HD resolution):
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads

I had luck installing and using it, but no matter what frame sizes I specified, I got those pink weird cropped frames every 5-10 frames (Using a transcend class 10 card, which others said they were able to use on small resolutions without issue).  I'm extremely excited about the RAW possibility, the files just have so much lattitude!  Any tips on how to get pink frame-free video on a 600d from someone who has tried it?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: arrinkiiii on May 14, 2013, 03:17:40 PM
it's like a big faceplam that it's always this darn dual-digic thing that hinds the work on the 7D.

thumbs up for the great work, but for us 7D users that's pretty disappointing after all. :(

Yes its true and sad  :'(   

600d/60D = because is cheap, so everybody got one
5D = because is the very best, full frame.

Still, thanks for the revolution in the DSLR world !!! Big game change !!!  ;D

Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: tackyattack on May 14, 2013, 03:25:11 PM
The forum user 1% has put together a compiled build for the 600d here (be warned that the SD card limits you to smaller than HD resolution):
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads

I had luck installing and using it, but no matter what frame sizes I specified, I got those pink weird cropped frames every 5-10 frames (Using a transcend class 10 card, which others said they were able to use on small resolutions without issue).  I'm extremely excited about the RAW possibility, the files just have so much lattitude!  Any tips on how to get pink frame-free video on a 600d from someone who has tried it?

Will it work on the 550d?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: KahL on May 14, 2013, 03:25:53 PM
The forum user 1% has put together a compiled build for the 600d here (be warned that the SD card limits you to smaller than HD resolution):
https://bitbucket.org/OtherOnePercent/tragic-lantern-2.0/downloads

I had luck installing and using it, but no matter what frame sizes I specified, I got those pink weird cropped frames every 5-10 frames (Using a transcend class 10 card, which others said they were able to use on small resolutions without issue).  I'm extremely excited about the RAW possibility, the files just have so much lattitude!  Any tips on how to get pink frame-free video on a 600d from someone who has tried it?

Thanks, just PM'ed you too.
No luck so far for me, but to be fair, I AM trying this on the 550D. Maybe it isn't prepared for that one yet, though usually 600D builds are compatible. So color me confused all the way.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 14, 2013, 04:11:18 PM
That won't work for 550D, its 600D only. I'm  not getting pink frames anymore most of the time.. sometimes jacked up frames. I haven't tried 1738 or 1740 again which were known bad.


Hehe, I got my own question....

whats up with printing uint64 or long long int with printf? I can cut off the 4gb limit but the indicators are all fucked up.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: KahL on May 14, 2013, 04:39:58 PM
That won't work for 550D, its 600D only. I'm  not getting pink frames anymore most of the time.. sometimes jacked up frames. I haven't tried 1738 or 1740 again which were known bad.


Hehe, I got my own question....

whats up with printing uint64 or long long int with printf? I can cut off the 4gb limit but the indicators are all fucked up.

Thanks 1%. I guess I'll just sit tight and follow the progress :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 05:54:13 PM

Hehe, I got my own question....

whats up with printing uint64 or long long int with printf? I can cut off the 4gb limit but the indicators are all fucked up.


Does this work:
printf("var = %llu\n", var);
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: bloomboy on May 14, 2013, 05:54:46 PM
I am looking for a working link to to the compatible OS X 1.1.3. Firmware file, is this on the ML forum somewhere?
As canon has it deleted from their database.
Thanks!
BB ;)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 05:58:52 PM

whats up with printing uint64 or long long int with printf? I can cut off the 4gb limit but the indicators are all fucked up.

Also regarding the 4gb cutoff, is it possible that the footer isn't getting properly written when the file is cut off? With any file that hit the limit, I get the 'Error: This ain't a lv_rec RAW file' message when I try to convert it. I have not yet tried pasting a footer onto the file.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: scrax on May 14, 2013, 06:02:19 PM
Also regarding the 4gb cutoff, is it possible that the footer isn't getting properly written when the file is cut off? With any file that hit the limit, I get the 'Error: This ain't a lv_rec RAW file' message when I try to convert it. I have not yet tried pasting a footer onto the file.
what are you using to convert them?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 14, 2013, 06:02:33 PM
Load a video in a hex editor and scroll until the end - you should see the footer starting with RAWM.

In the converter source, we have:
Code: [Select]
    FILE* fi = fopen(argv[1], "rb");
    CHECK(fi, "%s", argv[1]);
   
    fseek(fi, -sizeof(lv_rec_file_footer_t), SEEK_END);
    int r = fread(&lv_rec_footer, 1, sizeof(lv_rec_file_footer_t), fi);

which I guess it should work if fseek supports it.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 06:10:40 PM
what are you using to convert them?

Using raw2dng on osx. After work tonight I can try it on windows and see if it behaves any better or not.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: jordancolburn on May 14, 2013, 06:17:07 PM
That won't work for 550D, its 600D only. I'm  not getting pink frames anymore most of the time.. sometimes jacked up frames. I haven't tried 1738 or 1740 again which were known bad.
What settings are you using on the 600d?  I turned global draw off and went really conservative on the frame size and get constant pink frames every 5-10 frames with the latest binaries from your tragic lantern 2.0 repo.  Btw, thanks for the builds!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: scrax on May 14, 2013, 06:19:45 PM
Using raw2dng on osx. After work tonight I can try it on windows and see if it behaves any better or not.
it's because it's not 64bit, I need to update it.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 14, 2013, 06:29:43 PM
Quote
What settings are you using on the 600d?

Sraw and then frames like 1280x480 or something like that... a few different ones worked. 960x480 is pretty much continuous. Also recorded in 640x480.. I get a few more MB writing this way up to 18... so shrinking YUV edmacs will have effect... if we figure out how to disable HD buffer and face detection or make it output 1 line only I think there will be noticeable performance improvement.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 06:43:18 PM
it's because it's not 64bit, I need to update it.

Ahh ok that explains it, thanks.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: paramon on May 14, 2013, 07:29:54 PM
guys , do i need to use EOScard for CF cards?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Limiter on May 14, 2013, 07:58:56 PM
First off, AMAZING WORK ML team!!

Question regarding CF card and the Mark II: Will the KomputerBay cards work with the Mark II (they do work with Mark III)?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: sicetime on May 14, 2013, 08:00:54 PM
Thank you for your hard work!

Does anyone have the link to the most updated 5dIII build?

Is this it?

https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit
 
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: sicetime on May 14, 2013, 08:04:58 PM
Question regarding CF card and the Mark II: Will the KomputerBay cards work with the Mark II (they do work with Mark III)?

I know that Andrew from EOSHD Used the 128gb KomputerBay 1000x when he tested it, but haven't heard anything further.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: woj-o on May 14, 2013, 08:05:18 PM
One word A-M-A-Z-I-N-G.
It was very nice commented on EOSHD - 5DMKIII is best cinema camera right now - but that's without any thanks to Canon.

Any chances for it to work on 60D? (having it's low memory and slower (than CF) cards)?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: bensyverson on May 14, 2013, 08:32:17 PM
In the raw2dng file, rather than fseek'ing a fixed distance from the end of the file, I would recommend starting at the end of the file and gradually working back until the magic char ("RAWM") is in the "magic" element of the struct. Something like this:

Code: [Select]
off_t offset = 4;
fseek(fi, -offset, SEEK_END);

int r = fread(&lv_rec_footer, 1, sizeof(lv_rec_file_footer_t), fi);
while (strncmp((char *)fileFooter.magic, "RAWM", 4)) {
offset++;
fseek(fi, -offset, SEEK_END);
r = fread(&lv_rec_footer, 1, sizeof(lv_rec_file_footer_t), fi);
}

That will make it more flexible in case something goes wrong. You'll only need the very beginning of the footer to read the uncompressed data anyway.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Rush on May 14, 2013, 08:49:47 PM
Is raw_rec module is universal for all cameras? Can I replace raw_rec module 600D with the one from 6D?

UPDATE: Answer is yes! (btw, 1%, thanks for adding many resolutions)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 09:04:25 PM
Thinking about it, isn't the 4GB file size a limitation of the FAT32 filesystem? I'm not sure there's any option for longer clips besides opening a new file and continuing the data stream there. raw2dng would obviously need to be updated to work with this scheme. Unless there's something I'm missing?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 14, 2013, 09:15:26 PM
Don't worry about 4gb limit so much... I recorded over 4GB already, haven't had a chance to decode it... I'll probably have to add that patch above to the converter...

Only reason why its not mainstreamed is because the indicators and write speed get all screwed up form uint64... other than that no issues with longer clips.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Francis Frenkel on May 14, 2013, 09:23:40 PM
5D2 is working now, fyi.

It's working for 5dmar2 ?
How did you try it ?
How can I try it ?
have you got a tutorial to test it on a 5dmark2 ?

It's so greaaat !

Francis
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevegalle on May 14, 2013, 09:25:19 PM
Don't worry about 4gb limit so much... I recorded over 4GB already, haven't had a chance to decode it... I'll probably have to add that patch above to the converter...

lol ok, the only reason I'm interested in it is that the ability to record longer clips is make or break for my application (mkIII on a multirotor). I'll take your word that it's not a problem, I just didn't know the filesystem on CF cards was actually able to record past a limit of  4,294,967,295 bytes.

Thanks for the effort that's going into this, the results are really quite spectacular.

Steve
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 14, 2013, 09:38:13 PM
As long as its not fat32 you're ok. 5d3 *should* support exfat since it does for SD cards. I don't have a CF camera to mess with so not sure on like 50D/5dII/7D, etc.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: olik on May 14, 2013, 10:30:45 PM
would be cool if 5dmk2 could support exfat or ext3/4 or similar to overcome the 4gb limit of fat32. As an alternative, maybe ML could do a new .raw file when the size limit is reached, unless it would cause dropped frames.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Felixlgr on May 14, 2013, 11:02:02 PM
I am looking for a working link to to the compatible OS X 1.1.3. Firmware file, is this on the ML forum somewhere?
As canon has it deleted from their database.
Thanks!
BB ;)

you can get it here along with other Canon Firmwares

http://chdk.wikia.com/wiki/Official_Canon_firmware_updates
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: domisol on May 14, 2013, 11:18:36 PM
First all, congratulations and many thanks to all Magic Lantern for such a great job, and specially to coutts for porting to 5D2 which I'm using.

One question :
- Is it already possible to record at 24 fps, rather than 30 ? (ML overide doesn't seem to work neither Canon menu). raw_rec module and raw2dng indicates 29.97 fps.

One comment :
- I always get a "This ain't a lv_rec RAW file" error with 4 GB files, but sometimes also with smaller one, not sure exactly in which circumstances.

Thanks again.

Jean-David
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 14, 2013, 11:30:16 PM
Download the converter again, it was a bug.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: escho on May 14, 2013, 11:33:05 PM
Just compiled it. I can now convert 4GB. ThankYou for fixing.

Edgar
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a.d. on May 14, 2013, 11:59:27 PM
Hello Devs!
Since two days, I try to figure out how to compile the raw_rec modules for my 5D2 and it seems to work, but  i have some nasty warning. My Problem The Config Menu is there but I could not load raw_rec!
I'm on VirtualBox
Makefile.user:
Code: [Select]
ARM_ABI=none-eabi
ARM_PATH=~/arm-toolchain
GCC_VERSION=4.7.3
CONFIG_CONSOLE      = y
CONFIG_TCC          = y
CONFIG_MEMCHECK     = y
CONFIG_MODULES      = y
Warning:

../../src/memcheck.c: In function 'memcheck_add':
../../src/memcheck.c:98:46: warning: assignment discards 'const' qualifier from pointer target type [enabled by default]
../../src/memcheck.c: In function 'memcheck_malloc':
../../src/memcheck.c:141:29: warning: incompatible implicit declaration of built-in function 'malloc' [enabled by default]
../../src/memcheck.c:149:26: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
../../src/memcheck.c:159:5: warning: return makes pointer from integer without a cast [enabled by default]
../../src/memcheck.c: In function 'memcheck_free':
../../src/memcheck.c:193:22: warning: pointer targets in initialization differ in signedness [-Wpointer-sign]
../../src/memcheck.c:207:9: warning: incompatible implicit declaration of built-in function 'free' [enabled by default]
../../src/memcheck.c:207:9: warning: passing argument 1 of 'free' makes pointer from integer without a cast [enabled by default]
../../src/memcheck.c:207:9: note: expected 'void *' but argument is of type 'unsigned int'
../../src/memcheck.c: In function 'memcheck_main':
../../src/memcheck.c:231:25: warning: initialization makes integer from pointer without a cast [enabled by default]
[ CC       ]   console.o
[ CC       ]   tcc-glue.o
../../src/tcc-glue.c: In function 'tcc_compile_and_run':
../../src/tcc-glue.c:34:9: warning: incompatible implicit declaration of built-in function 'printf' [enabled by default]
../../src/tcc-glue.c:39:11: warning: 'main' is usually a function [-Wmain]
../../src/tcc-glue.c:66:9: warning: incompatible implicit declaration of built-in function 'printf' [enabled by default]
../../src/tcc-glue.c: In function 'open':
../../src/tcc-glue.c:146:5: warning: passing argument 2 of 'FIO_GetFileSize' from incompatible pointer type [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:532:1: note: expected 'uint32_t *' but argument is of type 'unsigned int *'
../../src/tcc-glue.c: In function 'read':
../../src/tcc-glue.c:179:5: warning: passing argument 2 of 'memcpy' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:549:1: note: expected 'const void *' but argument is of type 'long unsigned int'
../../src/tcc-glue.c: In function 'close':
../../src/tcc-glue.c:187:5: warning: passing argument 1 of 'free_dma_memory' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:558:1: note: expected 'const void *' but argument is of type 'int'
../../src/tcc-glue.c: In function 'fputc':
../../src/tcc-glue.c:240:1: warning: number of arguments doesn't match built-in prototype [enabled by default]
../../src/tcc-glue.c: In function 'tcc_compile_and_run':
../../src/tcc-glue.c:78:8: warning: 's' may be used uninitialized in this function [-Wuninitialized]

thanks in advance
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 15, 2013, 12:28:13 AM
I just installed the May 14th build on my 5d3. But I dont see the 'M' tab in the Magic Lantern Menu. So how am I supposed to enable the raw recording on this build?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: g3gg0 on May 15, 2013, 12:28:40 AM
but I could not load raw_rec!

error message?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 01:03:30 AM
I would like to know this too. I'm getting the same problem on my Mk II.

I've looked around, and Couttes posted a link yesterday to fix it with a previous autoexec.bin, but the extreme traffic to the dropbox file cause it to become disabled.

I've got the correct modules on my CF card, but I can't access the ability to change my settings to RAW. And "M" tab doesnt appear on my settings.

Thanks a lot guys for everything you've done.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 15, 2013, 01:16:47 AM
If there is no M in the menu its not a TCC enabled build.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: silvertonesx24 on May 15, 2013, 01:26:14 AM
I would like to know this too. I'm getting the same problem on my Mk II.

I've looked around, and Couttes posted a link yesterday to fix it with a previous autoexec.bin, but the extreme traffic to the dropbox file cause it to become disabled.

I've got the correct modules on my CF card, but I can't access the ability to change my settings to RAW. And "M" tab doesnt appear on my settings.

Thanks a lot guys for everything you've done.

Make sure that the MODULES folder is inside the ML folder. I had the same issue. I took the latest firmware and added in Couttes 5d2 fir from below

Latest Firmware with Modules
https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit

Couttes 5d2 fir
http://sdrv.ms/10xe8O9

Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 15, 2013, 01:30:50 AM
Make sure that the MODULES folder is inside the ML folder. I had the same issue. I took the latest firmware and added in Couttes 5d2 fir from below

Latest Firmware with Modules
https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit

Couttes 5d2 fir
http://sdrv.ms/10xe8O9

Is that May 14th build?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: silvertonesx24 on May 15, 2013, 01:35:30 AM
Is that May 14th build?

AFAIK the google drive ML link is the latest build. The 5d2 fir is from yesterday.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 01:55:48 AM
Still hasn't worked.

I took the 5D3 ML, and the 5D2 firmware, it all runs perfectly fine, but still missing the tab/ ability to shoot RAW.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 15, 2013, 01:59:04 AM
Still hasn't worked.

I took the 5D3 ML, and the 5D2 firmware, it all runs perfectly fine, but still missing the tab/ ability to shoot RAW.
Try the link posted 3 or so posts ago.
It is May 14th build, and it DOES include the M tab which allows you to load the module for raw recording. I just tested it. Seems to work just fine.

Devs, I like the addition of it telling me how fast my card must be to write the files(based on the dimensions that I put) nice touch!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 02:47:43 AM
Seriously man, I cant get it to work.

I apply the May 14th build to the CF card, and it all runs fine. I then apply the 5D3 alpha ML to it, and it still runs fine, but still unable to access the module, even though it all exists on the CF card.

Whenever I put any other file on it from the 5D3 alpha (5D3-113-bootflag, or autoexec), it temporarily bricks the CF card.

I don't know what else to do.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: danidm on May 15, 2013, 02:49:32 AM
I have the same problem than Iopsis
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 15, 2013, 02:53:52 AM
I had similar prob.  Delete the MAGIC.CFG file in the SETTINGS folder under ML.  Put card back and start cam, maybe it will fix it!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 02:58:36 AM
I had similar prob.  Delete the MAGIC.CFG file in the SETTINGS folder under ML.  Put card back and start cam, maybe it will fix it!

Yeh thanks, I always just delete all the files, and start afresh. That always fixes it!

But it's still a mystery to why the Module doesn't exist on the camera settings...
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 15, 2013, 03:04:53 AM
I use this one by lourenco and it works.  try it
https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit?usp=sharing
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 03:10:04 AM
I use this one by lourenco and it works.  try it
https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit?usp=sharing

Thats the one I'm use, but with 5D2 firmware and autoexec from 14th May.

Since 5D3 firmware won't work on a Mk II...will it?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Chungdha on May 15, 2013, 03:10:45 AM
I been looking through the forums but can't see the compiling codes, I wouldn't mind trying to compile a version for 550D to test out if it workable. Can anyone direct me to the right post with the codes? Or if someone could quickly compile on for 550D i wouldn't mind to test it out.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 15, 2013, 03:18:23 AM
Thats the one I'm use, but with 5D2 firmware and autoexec from 14th May.

Since 5D3 firmware won't work on a Mk II...will it?

Sorry I have only for 5D3
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Iopsis on May 15, 2013, 03:26:04 AM
Sorry I have only for 5D3

Thanks for your help anyway man, much appreciated :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: blueranger1980 on May 15, 2013, 05:32:45 AM
Thank you for your hard work!

Does anyone have the link to the most updated 5dIII build?

Is this it?

https://docs.google.com/file/d/0B7QlH_BH2m32T3RSTXRUM1VXTWM/edit

DO I need to organize all of these files into how the normal ML firmaware looks?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: jordancolburn on May 15, 2013, 05:49:52 AM
Sraw and then frames like 1280x480 or something like that... a few different ones worked. 960x480 is pretty much continuous. Also recorded in 640x480.. I get a few more MB writing this way up to 18... so shrinking YUV edmacs will have effect... if we figure out how to disable HD buffer and face detection or make it output 1 line only I think there will be noticeable performance improvement.
I believe I turned the experimental sraw function on, but still recieved about the same results.  My class 10 card isn't very fast (15-18mb in the benchmark) but I still get the partial pink frames on the low 720x320 resolution.  It appears to happen slightly less frequently on the lower resolution options, but there is still at least 1 frame of pink junk per second even with continual shooting and no frame drops.  Is my card just that much too slow, or could I be missing another important setting?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 15, 2013, 06:12:08 AM
DO I need to organize all of these files into how the normal ML firmaware looks?

click 'file' at the top and download.
That will download all of the files and they will be correctly organized
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: d on May 15, 2013, 06:22:25 AM
I managed to build the nightly for my 5D2 and 1280x720 raw video is as lovely as expected, but it doesn't seem to want to let me record at 1920x1080 or higher. Is this a limitation of the 5D2 versus the newer cameras?

(http://i.imgur.com/GvjUceE.png)

(Yes, 1280 is the right height; I'm a sucker for 3:2)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 15, 2013, 07:47:54 AM
I managed to build the nightly for my 5D2 and 1280x720 raw video is as lovely as expected, but it doesn't seem to want to let me record at 1920x1080 or higher. Is this a limitation of the 5D2 versus the newer cameras?

(http://i.imgur.com/GvjUceE.png)

(Yes, 1280 is the right height; I'm a sucker for 3:2)
I believe that in some cases, it's a card speed limitation.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 15, 2013, 07:53:55 AM
"Can't do resolution X" means a limitation of the current sensor sampling mode.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Kabuto1138 on May 15, 2013, 08:17:28 AM
"Can't do resolution X" means a limitation of the current sensor sampling mode.

So even if we get the Toshiba 1066x cards, it won't help?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 15, 2013, 08:27:49 AM
sensor = the thing that gives you the image...
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: pavelpp on May 15, 2013, 08:49:08 AM
Can someone please compile a test build with raw rec for 550d?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 15, 2013, 08:57:50 AM
Before compiling, one needs to do some reverse engineering and figure it out. It takes time.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a.d. on May 15, 2013, 10:03:51 AM
error message?
Sorry, i was tired!
Correction on my previous post: without tinypy it will not compile
Code: [Select]
ARM_ABI=none-eabi
ARM_PATH=~/arm-toolchain
GCC_VERSION=4.7.3
CONFIG_CONSOLE      = y
CONFIG_TCC          = y
CONFIG_MEMCHECK     = y
CONFIG_MODULES      = y
CONFIG_TINYPY       = y
to be clear:
the autoexec.bin and raw_rec.mo are  ok - so far -  but it generate 0 Byte magiclantern.sym

/bin/sh: 1: gawk: not found

Update:
Next Step:
Thanks to a1ex! on the TCC Thread!
I need to install gawk.

Solve! ;D thanks g3gg0 and a1ex!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 15, 2013, 07:47:00 PM
A1ex gr3ggo 1% are there plans in implementing this in an alpha? I remember reading that you guys would rather keep making new features than try and put all nightly's in to an alpha, but that was before this raw feature, do you still feel the same way? How much testing needs to be done before you feel comfortable doing something like this?

As always, thank you for your hard work and dedication

I am also concerned about all these versions of ML that may or may not be compiled correctly.  I am not a programer and have spent many hours making my own compile in windows and Gygwin which I finally got it working.  I prefer to compile myself to make sure I have the latest and dont have to ask anyone to do it for me.

IMHO it is best if that the correct compiled version is build into nightly builds, if there is somebody who can dedicate the time to do it.  The other option is to have an up to date instructive on how to compile it so that all interested and apt people can do it.  I could write an instructive for windows (for the 5D3) compile and Cygwin which would be complementary to what PEL did but I don't think I am qualified to do it so it could be misleading.

Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 15, 2013, 07:56:59 PM
This stuff is still being tested. All the info is on here, code is available... Maybe for nightly builds people want picoC or something else. There haven't been any real changes since double buffering was implemented.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aaphotog on May 16, 2013, 03:14:43 AM
I seen it once before, but can't seem to find it. Anyone know a good source to learn how to compile the builds?
I notice there are new additions to ML every few hours and would like to know how I can build them(for installation)


https://bitbucket.org/hudson/magic-lantern/commits/ecc6fd42fb3afbc122849ba929168340574d41aa

I am  on a mac system, if that information helps.



NVM found it(instructions on compiling):
http://www.magiclantern.fm/forum/index.php?topic=991.0
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Fergus Kennedy on May 16, 2013, 12:05:53 PM
I also posted this in another section, then realised this might be a better place- Any help greatly appreciated!

Hi Folks,

First of all- massive thanks to the developers- I'm so excited about this and can't wait to get it running.
Apologies for what may be a stupid newb question, but I'm having trouble getting the RAW capable ML on my 5D Mark III. In the past I've had previous alpha version on it no probs.
This time I've been following all posted instructions to the letter (I think!). Canon firmware 1.1.3, camera on M, etc. When I load the bootflag.fir I get an  error message - could not find ML files, followed by a series of other messages, then some garbage half way up the screen, which stays there. Is this normal behaviour?
Moving onto the next steps, I have deleted the bootflag file and added the ML folder and autoexec file. Plus made the card bootage with EOScard, following the instructions for that. When I load it up, nothing happens when I press the trash button.
I have tried several different SD cards and have cleared all camera settings and have even tried reinstalling the Canon firmware.
HELP- it would be fantastic if someone had any idea where I am going wrong, or anything else to try as it's driving me nuts!
Cheers
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Francis on May 16, 2013, 06:42:27 PM
I'm having issues compiling on the 5D2. Enabled all the compilation flags in the makefile, getting this exit error.


Code: [Select]
vsscanf.c:(.text+0x5c): warning: warning: the scanf functions add several kilobytes of bloat.
dietlibc.a(sprintf.o): In function `sprintf':
sprintf.c:(.text+0x14): warning: warning: Avoid *sprintf; use *snprintf. It is more secure.
collect2: error: ld returned 1 exit status
make[1]: *** [magiclantern] Error 1
make: *** [5D2] Error 2

Suggestions?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: paramon on May 16, 2013, 06:55:18 PM
I get an  error message - could not find ML files, followed by a series of other messages, then some garbage half way up the screen, which stays there. Is this normal behaviour?
yes, just make sure you let enough time for couple lines of "garbage" to appear, it writes a file at that time
Moving onto the next steps, I have deleted the bootflag file and added the ML folder and autoexec file. Plus made the card bootage with EOScard, following the instructions for that. When I load it up, nothing happens when I press the trash button.
yes looks right, you copy ML  folder and autoexec, then you use EOScard, just don't forget to check EOS_DEVELOP and BOOTDISC check boxes
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Fergus Kennedy on May 16, 2013, 07:26:31 PM
yes, just make sure you let enough time for couple lines of "garbage" to appear, it writes a file at that timeyes looks right, you copy ML  folder and autoexec, then you use EOScard, just don't forget to check EOS_DEVELOP and BOOTDISC check boxes

Thanks so much for the tip, Paramon. I still can't get it working, but at least I know problem is with the second stage, not the first. I've been checking both those boxes in EOScard (or sometimes just BOOTDISC, which some people seem to suggest). After the bootflag process I get a ROM.dat file on the card of 16mb I guess this is right.

Any more things to try greatly appreciated.

Thanks again.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: mujart on May 16, 2013, 10:58:46 PM
i use this files in my 5D MK III,
https://docs.google.com/file/d/0B7QlH_BH2m32dWpOOEpkWktXMXM/edit

the problem there is the line of RAW VIDEO  NOT exist basically

like this photos:

(http://img441.imageshack.us/img441/4922/photohms.jpg)


and when press on load modules nothing happend !!

is there any solution??
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: paramon on May 16, 2013, 11:30:35 PM
After the bootflag process I get a ROM.dat file on the card of 16mb I guess this is right.
yeah, tat's how i made it work on 5DmkIII,
don't see any missing steps from what you're doing,
i don't know man, try another card, another build, no clue man, i am myself new to this shit :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: premini on May 17, 2013, 01:05:23 AM
i am not that optimistic that there will be a quick solution :(

Still not optimistic?  :(
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 17, 2013, 01:07:28 AM
Are we there yet... are we there yet... are we there yet.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: platu on May 17, 2013, 01:15:20 AM
Are we there yet... are we there yet... are we there yet.

So funny... was thinking the same thing.  :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: premini on May 17, 2013, 01:35:52 AM
Sorry guys...  :-[
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Francis on May 17, 2013, 05:52:12 PM
Yea, it would be great if not every thread that mentioned RAW turned into the endless repetitive when when when.

This thread is about compiling and installing.

So I'm still having issues getting the current source to compile. enabled  the flags for modules, tcc, tinypy, console, and memtest but exits with an error.

Now it says

Code: [Select]
sprintf.c:(.text+0x14): warning: warning: Avoid *sprintf; use *snprintf. It is more secure.
edmac-memcpy.o: In function `edmac_copy_rectangle_adv_start':
edmac-memcpy.c:(.text+0xbc): undefined reference to `RegisterEDmacCompleteCBR'
edmac-memcpy.c:(.text+0xcc): undefined reference to `RegisterEDmacAbortCBR'
edmac-memcpy.c:(.text+0xe0): undefined reference to `RegisterEDmacPopCBR'
edmac-memcpy.c:(.text+0xf0): undefined reference to `RegisterEDmacCompleteCBR'
edmac-memcpy.c:(.text+0x100): undefined reference to `RegisterEDmacAbortCBR'
edmac-memcpy.c:(.text+0x110): undefined reference to `RegisterEDmacPopCBR'
edmac-memcpy.o: In function `edmac_copy_rectangle_adv_finish':
edmac-memcpy.c:(.text+0x1cc): undefined reference to `UnregisterEDmacCompleteCBR'
edmac-memcpy.c:(.text+0x1d4): undefined reference to `UnregisterEDmacAbortCBR'
edmac-memcpy.c:(.text+0x1dc): undefined reference to `UnregisterEDmacPopCBR'
edmac-memcpy.c:(.text+0x1e4): undefined reference to `UnregisterEDmacCompleteCBR'
edmac-memcpy.c:(.text+0x1ec): undefined reference to `UnregisterEDmacAbortCBR'
edmac-memcpy.c:(.text+0x1f4): undefined reference to `UnregisterEDmacPopCBR'
collect2: error: ld returned 1 exit status
make[1]: *** [magiclantern] Error 1
make: *** [5D2] Error 2

I'm compiling on a Mac using prebuilt tool chain, using 'make 5D2.'
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 17, 2013, 05:56:31 PM
You need the stubs from Coutts build
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Colemar on May 17, 2013, 09:56:10 PM
The latest 5D3 modules build from lourenco does not work for me.  After loading the raw_rec module, its status is "No_Info" instead of the usual "OK" and the "Raw Video" ("Video" being a misnomer if de-bayering is not happening in-camera) option is absent from the ML video menu.  Is anyone else experiencing this?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 17, 2013, 10:39:10 PM
I had this issue at some point; had to run make clean in module dir. No idea what's causing it.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Vegandelight on May 17, 2013, 10:49:55 PM
Did i miss like the normal compilation guide for ML?

Am I suppose to get that MAGIC.SYM when compiling raw_rec module? I see it in the versions I download, but I haven't seen any when I'm doing it.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 17, 2013, 10:58:01 PM
"make install" will create it; in the work dir it's called "magiclantern.sym" for some reason... don't ask me why :P
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 17, 2013, 11:00:55 PM
Should it be renamed to MAGIC.SYM in the makefiles?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 17, 2013, 11:07:23 PM
I would rename it to 550D.sym, 6D.sym and so on. It will help when we'll use the same zip for more cameras.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Vegandelight on May 17, 2013, 11:15:25 PM
I would rename it to 550D.sym, 6D.sym and so on. It will help when we'll use the same zip for more cameras.

Can it be named whatever we want in the modules dir, does it matter?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 17, 2013, 11:17:23 PM
Thats not bad... just really annoying to keep renaming MAGIC.SYM, if it used 6D.SYM then sure, otherwise same issue.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: a1ex on May 17, 2013, 11:32:09 PM
Didn't notice the annoyance - "make install" creates the entire directory structure on the card, no need to rename manually.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Vegandelight on May 18, 2013, 12:36:39 AM
Finally got it running. Why doesnt make install copy raw_rev.o? maybe thats not even needed?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: fabiogalvanifurtado on May 18, 2013, 11:59:58 PM
Hi, guys!

I got a 5D MKIII, but with the new 1.2.1 firmware. Magic Lantern only functions on the 1.1.3, that's it? Anyone could please tell me where to download the 1.1.3 version??

Best regards, this job you're doing is really amazing :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 19, 2013, 01:50:06 AM
Hi, guys!

I got a 5D MKIII, but with the new 1.2.1 firmware. Magic Lantern only functions on the 1.1.3, that's it? Anyone could please tell me where to download the 1.1.3 version??

Best regards, this job you're doing is really amazing :)

Where to get Canon Firmware 1.1.3 for sure:
HERE: http://pel.hu/eoscard/

Also look at this:

How to install Magic Lantern on 5D Mark III
HERE: http://www.magiclantern.fm/forum/index.php?topic=2602.0
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevefal on May 20, 2013, 07:52:57 PM
Any idea why building is failing for me?

Makefile.user: http://popspring.com/mldrop/Makefile.txt (http://popspring.com/mldrop/Makefile.txt)

Output: http://popspring.com/mldrop/mlfail.txt (http://popspring.com/mldrop/mlfail.txt)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: escho on May 20, 2013, 08:11:21 PM
Any idea why building is failing for me?

Makefile.user: http://popspring.com/mldrop/Makefile.txt (http://popspring.com/mldrop/Makefile.txt)

Output: http://popspring.com/mldrop/mlfail.txt (http://popspring.com/mldrop/mlfail.txt)

try to disable picoc

Edgar
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: wolf on May 20, 2013, 08:12:20 PM
Try to disable picoc.

Edit: didn't refresh my site
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: stevefal on May 20, 2013, 08:22:51 PM
Quote
try to disable picoc.

Thanks, but it still fails. Other ideas?

[created another thread at http://www.magiclantern.fm/forum/index.php?topic=5537.0]
Title: Re: Offering 8-10-12 and 14bits RAW
Post by: danap on May 20, 2013, 08:27:42 PM
Obviously, current CF cards writing speeds stretches the possibilities of the raw recording on Canon  cameras. Therefore my question and possible suggestion for a new user managed bit depth:
Could the raw_rec module offer options to strip the 14bits depth down to 12, 10 and even 8 bits. The raw file would be much thinner and writable to a large number of CF cards and cameras?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Colemar on May 20, 2013, 10:02:31 PM
Could the raw_rec module offer options to strip the 14bits depth down to 12, 10 and even 8 bits.

I think all the raw-rec module is doing is saving a datastream the sensor is outputting anyway.  There is no processing happening which is why the camera will not overheat and the sensor will not be damaged.  Also why post workflow has not been solidified.  So no, it would not be possible to convert the 14bit datastream into a lower bitrate without processing in-camera, which defeats the purpose of this modification.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: vicnaum on May 20, 2013, 10:35:36 PM
which defeats the purpose of this modification.

Well, I'd rather say that if possible - we should do something with uncompressed raw - cause 25 minutes at 128 GB card is just HUGE and unreal. Should be like REDCODE (20-40MB/s) or smth, cause 90MB/s is really overwhelm. Lossy or lossless - but not that huge.

The other question is - if it's feasible to process the full uncompressed RAW stream with our DIGIC, cause it's still a question to me if it is powerful enough to handle such huge amounts of data in realtime.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Colemar on May 20, 2013, 10:50:45 PM
Well, I'd rather say that if possible - we should do something with uncompressed raw - cause 25 minutes at 128 GB card is just HUGE and unreal.
The benefit of what Magic Lantern is doing here is pristine data straight from the sensor.  Compression ruins that and makes it just Lantern.  Voluminous data is a consequence of shooting raw, no getting around that.

The other question is - if it's feasible to process the full uncompressed RAW stream with our DIGIC,
the DIGIC processor is not processing the raw datastream.  The beauty of all of this is ML devs were able to bypass all of Canon's image processing and deliver a stream of image data that is 14bits deep and glorious.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: kgv5 on May 20, 2013, 11:04:37 PM
Well, I'd rather say that if possible - we should do something with uncompressed raw - cause 25 minutes at 128 GB card is just HUGE and unreal. Should be like REDCODE (20-40MB/s) or smth, cause 90MB/s is really overwhelm. Lossy or lossless - but not that huge.

The other question is - if it's feasible to process the full uncompressed RAW stream with our DIGIC, cause it's still a question to me if it is powerful enough to handle such huge amounts of data in realtime.

To save some space you can always decrease a resolution a little bit.
I have a 6D and unfortunatelly with SD only usable res (say ~400frames without any skip) for now is 1504x640. It is 2,35:1 aspect ratio.
Such a resolution has some advantages - one frame is about 1,64MB, bitrate ~37MB/s, it's still 14bit. After resizing in AE by ~130% resolution obviously looks worse than 1080p raw but the same as 1080p h264. There is much more details and dynamic range. I wonder how it compares with say prores 422HQ or even prores 444 (similar bitrate) in terms of image quality. With 64GB card you can have about 26 minutes of footage.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: vicnaum on May 21, 2013, 06:39:20 AM
The benefit of what Magic Lantern is doing here is pristine data straight from the sensor.  Compression ruins that and makes it just Lantern.  Voluminous data is a consequence of shooting raw, no getting around that.
the DIGIC processor is not processing the raw datastream.  The beauty of all of this is ML devs were able to bypass all of Canon's image processing and deliver a stream of image data that is 14bits deep and glorious.

Yes, I know that it just flushes the buffers to card.

But even professional cameras (like RED) have lossy compressed RAW and no one cries about it. And I would prefer 1920x1080 lossy comressed, than 960x480 uncompressed.

The possibility of processing is still questionable.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Colemar on May 21, 2013, 07:00:21 AM
apologies I misunderstood.  I see now from the nametag you are shooting on a 600D, I assumed 5Dmk2 or 3.  Still, the fact that a Canon DSLR can compare to a camera from RED because of the efforts of volunteers is astonishing.  The fact they got it to shoot a picture with more color resolution than an Alexa is ridiculous.  I see your point on in-camera processing, just don't agree it's necessary.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: vicnaum on May 21, 2013, 08:14:55 AM
apologies I misunderstood.  I see now from the nametag you are shooting on a 600D, I assumed 5Dmk2 or 3.  Still, the fact that a Canon DSLR can compare to a camera from RED because of the efforts of volunteers is astonishing.  The fact they got it to shoot a picture with more color resolution than an Alexa is ridiculous.  I see your point on in-camera processing, just don't agree it's necessary.

Right, on 5Dmk2-3 it's surely not so necessary (as long as you have tons of fast 128GB cards or guys invent CF->SSD converter). And surely great as a test. And an awesome breakthrough.

But now it looks more like a "proof-of-concept" to me. Cause for production use - when you need 2-4-6 hours of footage per day - you'll need to buy 10-15-20 CF cards for these bitrates, and assuming each one costs 300-400$ - you can get a used RED ONE for these money :-)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: dude on May 21, 2013, 11:02:43 AM
Would it be possible to delete the Raw Files on Cam? Would be lot easier because you would have more space(deleting unusable takes) which is needed with raw.

Thanks
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Jackie on May 22, 2013, 01:23:11 AM
Hello guys I have a litle problem when i want to compile normal nightly build everything is ok but when I enable TCC modules and memcheck in the makefile it end up like this and I think I have all the software updated to its newest versions any idea where is the problem ? I´m using gcc-arm-none-eabi-4_7-2013q1 and cygwin thanks in advance for any advice ;)

Code: [Select]
[email protected] ~
$ cd c:/cygwin/home/jackie/magic-lantern/platform/5D3.113

[email protected] /home/jackie/magic-lantern/platform/5D3.113
$ make clean && make
[ CLEAN    ]   clean
[ CLEAN    ]   clean
[ CPP      ]   magiclantern.lds
~/gcc-arm-none-eabi-4_7-2013q1/bin/arm-none-eabi-gcc-4.7.3.exe    -c -o ../../src/entry.o ../../src/entry.S
[ AS       ]   ../../platform/5D3.113/stubs.o
echo 'const char build_version[] = "v2.3.NEXT.2013May22.5D3113";' > ../../platform/5D3.113/version.c
echo 'const char build_id[] = "'`hg id`'";' >> ../../platform/5D3.113/version.c
echo 'const char build_date[] ="'`date -u "+%Y-%m-%d %H:%M:%S"`'";' >> ../../platform/5D3.113/version.c
echo 'const char build_user[] = "'`whoami`@`hostname`'";'  >> ../../platform/5D3.113/version.c
[ CC       ]   version.o
[ CC       ]   boot-hack.o
[ CC       ]   ico.o
[ CC       ]   edmac.o
[ CC       ]   menu.o
[ CC       ]   debug.o
../../src/debug.c:4599:12: warning: 'zoom_in_pressed' defined but not used [-Wunused-variable]
[ CC       ]   cfn.o
[ CC       ]   gui.o
[ CC       ]   picstyle.o
[ CC       ]   exmem.o
[ CC       ]   bmp.o
[ CC       ]   font-dyn.o
[ CC       ]   config.o
[ CC       ]   stdio.o
[ CC       ]   bitrate-5d3.o
[ CC       ]   tweaks.o
[ CC       ]   lens.o
[ CC       ]   property.o
[ CC       ]   propvalues.o
[ CC       ]   gui-common.o
[ CC       ]   chdk-gui_draw.o
[ CC       ]   movtweaks.o
[ CC       ]   menuhelp.o
[ MENU IDX ]   menuindexentries.h
No menuindex.txt not running "python2 menuindex.py"
[ CC       ]   menuindex.o
[ CC       ]   focus.o
[ CC       ]   notify_box.o
[ CC       ]   dialog_test.o
[ CC       ]   vram.o
[ CC       ]   aj_port.o
[ CC       ]   fps-engio.o
[ CC       ]   shoot.o
[ CC       ]   hdr.o
[ CC       ]   lv-img-engio.o
[ CC       ]   state-object.o
[ CC       ]   tasks.o
[ CC       ]   beep.o
[ CC       ]   vsync-lite.o
[ CC       ]   tskmon.o
[ CC       ]   battery.o
[ CC       ]   imgconv.o
../../src/imgconv.c: In function 'yuv411_to_rgb':
../../src/imgconv.c:189:16: warning: unused variable 'c' [-Wunused-variable]
[ CC       ]   histogram.o
[ CC       ]   falsecolor.o
[ CC       ]   audio-ak.o
[ CC       ]   zebra.o
[ CC       ]   video_hacks.o
[ CC       ]   fio-5d3.o
[ CC       ]   misc.o
[ CC       ]   ph_info_disp.o
[ CC       ]   flexinfo.o
[ CC       ]   afma.o
[ CC       ]   raw.o
[ CC       ]   chdk-dng.o
[ CC       ]   edmac-memcpy.o
../../src/edmac-memcpy.c: In function 'edmac_memset':
../../src/edmac-memcpy.c:145:5: warning: passing argument 1 of 'memset' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/edmac-memcpy.c:2:0:
../../src/dryos.h:56:15: note: expected 'void *' but argument is of type 'long unsigned int'
../../src/edmac-memcpy.c:148:5: warning: passing argument 1 of 'edmac_copy_rectangle_adv_start' makes pointer from integer without a cast [enabled by default]
../../src/edmac-memcpy.c:46:7: note: expected 'void *' but argument is of type 'long unsigned int'
../../src/edmac-memcpy.c:148:5: warning: passing argument 2 of 'edmac_copy_rectangle_adv_start' makes pointer from integer without a cast [enabled by default]
../../src/edmac-memcpy.c:46:7: note: expected 'void *' but argument is of type 'long unsigned int'
../../src/edmac-memcpy.c:157:9: warning: passing argument 1 of 'memset' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/edmac-memcpy.c:2:0:
../../src/dryos.h:56:15: note: expected 'void *' but argument is of type 'long unsigned int'
[ CC       ]   asm.o
../../src/asm.c: In function 'seems_to_be_string':
../../src/asm.c:22:15: warning: incompatible implicit declaration of built-in function 'strlen' [enabled by default]
../../src/asm.c: In function 'asm_guess_func_name_from_string':
../../src/asm.c:36:26: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
[ CC       ]   memcheck.o
../../src/memcheck.c: In function 'memcheck_add':
../../src/memcheck.c:98:46: warning: assignment discards 'const' qualifier from pointer target type [enabled by default]
../../src/memcheck.c: In function 'memcheck_malloc':
../../src/memcheck.c:141:29: warning: incompatible implicit declaration of built-in function 'malloc' [enabled by default]
../../src/memcheck.c:149:26: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
../../src/memcheck.c:159:5: warning: return makes pointer from integer without a cast [enabled by default]
../../src/memcheck.c: In function 'memcheck_free':
../../src/memcheck.c:193:22: warning: pointer targets in initialization differ in signedness [-Wpointer-sign]
../../src/memcheck.c:207:9: warning: incompatible implicit declaration of built-in function 'free' [enabled by default]
../../src/memcheck.c:207:9: warning: passing argument 1 of 'free' makes pointer from integer without a cast [enabled by default]
../../src/memcheck.c:207:9: note: expected 'void *' but argument is of type 'unsigned int'
../../src/memcheck.c: In function 'memcheck_main':
../../src/memcheck.c:231:25: warning: initialization makes integer from pointer without a cast [enabled by default]
[ CC       ]   console.o
[ CC       ]   pico.o
In file included from ../../picoc/pico.c:1:0:
../../picoc/platform.h:68:0: warning: "malloc" redefined [enabled by default]
In file included from ../../picoc/../src/dryos.h:633:0,
                 from ../../picoc/platform.h:33,
                 from ../../picoc/pico.c:1:
../../picoc/../src/memcheck.h:10:0: note: this is the location of the previous definition
In file included from ../../picoc/pico.c:1:0:
../../picoc/platform.h:71:0: warning: "free" redefined [enabled by default]
In file included from ../../picoc/../src/dryos.h:633:0,
                 from ../../picoc/platform.h:33,
                 from ../../picoc/pico.c:1:
../../picoc/../src/memcheck.h:11:0: note: this is the location of the previous definition
In file included from ../../picoc/pico.c:13:0:
../../picoc/pico.c: In function 'PlatformExit':
../../picoc/platform_ml.c:62:1: warning: 'noreturn' function does return [enabled by default]
[ CC       ]   picoc.o
[ CC       ]   chdk-gui_script.o
[ CC       ]   tcc-glue.o
../../src/tcc-glue.c: In function 'tcc_compile_and_run':
../../src/tcc-glue.c:34:9: warning: incompatible implicit declaration of built-in function 'printf' [enabled by default]
../../src/tcc-glue.c:39:11: warning: 'main' is usually a function [-Wmain]
../../src/tcc-glue.c:66:9: warning: incompatible implicit declaration of built-in function 'printf' [enabled by default]
../../src/tcc-glue.c: In function 'open':
../../src/tcc-glue.c:146:5: warning: passing argument 2 of 'FIO_GetFileSize' from incompatible pointer type [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:532:1: note: expected 'uint32_t *' but argument is of type 'unsigned int *'
../../src/tcc-glue.c: In function 'read':
../../src/tcc-glue.c:179:5: warning: passing argument 2 of 'memcpy' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:549:1: note: expected 'const void *' but argument is of type 'long unsigned int'
../../src/tcc-glue.c: In function 'close':
../../src/tcc-glue.c:187:5: warning: passing argument 1 of 'free_dma_memory' makes pointer from integer without a cast [enabled by default]
In file included from ../../src/tcc-glue.c:9:0:
../../src/dryos.h:558:1: note: expected 'const void *' but argument is of type 'int'
../../src/tcc-glue.c: In function 'fputc':
../../src/tcc-glue.c:240:1: warning: number of arguments doesn't match built-in prototype [enabled by default]
../../src/tcc-glue.c: In function 'tcc_compile_and_run':
../../src/tcc-glue.c:78:8: warning: 's' may be used uninitialized in this function [-Wuninitialized]
[ CC       ]   tcc-gui.o
[ CC       ]   script_lib.o
make -C ../../tcc
make[1]: Entering directory `/home/jackie/magic-lantern/tcc'
make[1]: Nothing to be done for `all'.
make[1]: Leaving directory `/home/jackie/magic-lantern/tcc'
[ CC       ]   module.o
[ AR       ]   strrchr.o
[ AR       ]   dietlibc.a
[ AR       ]   lib_a-setjmp.o
[ AR       ]   newlib-libc.a
[ LD       ]   magiclantern
tcc-gui.o: In function `handle_picoc_keys':
tcc-gui.c:(.text+0x518): multiple definition of `handle_picoc_keys'
picoc.o:picoc.c:(.text+0x660): first defined here
tcc-gui.o: In function `script_setup_param':
tcc-gui.c:(.text+0x5c8): multiple definition of `script_setup_param'
picoc.o:picoc.c:(.text+0x72c): first defined here
tcc-gui.o: In function `script_reset_params':
tcc-gui.c:(.text+0x620): multiple definition of `script_reset_params'
picoc.o:picoc.c:(.text+0x784): first defined here
tcc-gui.o: In function `script_open_submenu':
tcc-gui.c:(.text+0x9a8): multiple definition of `script_open_submenu'
picoc.o:picoc.c:(.text+0xb0c): first defined here
tcc-gui.o: In function `script_setup_title':
tcc-gui.c:(.text+0xa28): multiple definition of `script_setup_title'
picoc.o:picoc.c:(.text+0xb8c): first defined here
tcc-gui.o: In function `script_key_dequeue':
tcc-gui.c:(.text+0xa5c): multiple definition of `script_key_dequeue'
picoc.o:picoc.c:(.text+0xbc0): first defined here
tcc-gui.o: In function `script_key_enqueue':
tcc-gui.c:(.text+0xa9c): multiple definition of `script_key_enqueue'
picoc.o:picoc.c:(.text+0xc00): first defined here
tcc-gui.o:(.bss+0x4): multiple definition of `script_stop_requested'
picoc.o:(.bss+0x4): first defined here
dietlibc.a(vsscanf.o): In function `vsscanf':
vsscanf.c:(.text+0x5c): warning: warning: the scanf functions add several kilobytes of bloat.
dietlibc.a(sprintf.o): In function `sprintf':
sprintf.c:(.text+0x14): warning: warning: Avoid *sprintf; use *snprintf. It is more secure.
collect2.exe: error: ld returned 1 exit status
../../Makefile.inc:562: recipe for target `magiclantern' failed
make: *** [magiclantern] Error 1
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 22, 2013, 01:27:25 AM
PicocC has to be disabled in Makefile.user

CONFIG_PICOC = n

Also make clean before you make

Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Jackie on May 23, 2013, 08:47:55 AM
PicocC has to be disabled in Makefile.user

CONFIG_PICOC = n

Also make clean before you make
Thank you it works after disabling the picoc lovely :)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Mayo on May 23, 2013, 02:09:49 PM
Noob question: I can compile magic lantern just fine, but what's the correct procedure to make the modules?

When I try to make raw_rec.o from /modules/raw_rec/ I get:

Code: [Select]
[ CC       ]   raw_rec.o
raw_rec.c:20:20: fatal error: module.h: No such file or directory
compilation terminated.
make: *** [raw_rec.o] Error 1

Thanks.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 23, 2013, 02:13:14 PM
Noob question: I can compile magic lantern just fine, but what's the correct procedure to make the modules?

When I try to make raw_rec.o from /modules/raw_rec/ I get:

Code: [Select]
[ CC       ]   raw_rec.o
raw_rec.c:20:20: fatal error: module.h: No such file or directory
compilation terminated.
make: *** [raw_rec.o] Error 1
Are you compiling in windows cygwin?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Mayo on May 23, 2013, 02:14:03 PM
Are you compiling in windows cygwin?

Yes.

Edit: Ah, nevermind, it was right before my eyes  ::)

Code: [Select]
* - enable modules in Makefile.user (CONFIG_MODULES = y, CONFIG_TCC = y, CONFIG_PICOC = n, CONFIG_CONSOLE = y)
Edit 2: Ah well, same problem. Any help is much appreciated.

Edit 3: replaced TOP_DIR=$(PWD)/../.. with TOP_DIR=../.. in the makefile : I got raw_rec.mo to compile \o/
Now, on to raw2dng...
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 23, 2013, 02:52:18 PM
Ok, I use windows compile so I can help you just a bit since I am not a programer or DEV.

Here is my latest Makefile.user for reference and make sure you have all of those CONFIG_XXXX  set right!

GCC_VERSION=4.7.3
ARM_ABI=none-eabi
ARM_PATH=../../../arm-toolchain473
ARM_LIBC_A=../../../arm-toolchain473/arm-none-eabi/lib/libc.a
PYTHON=python2.6
CONFIG_CONSOLE = y
CONFIG_TCC          = y
CONFIG_MEMCHECK     = y
CONFIG_MODULES      = y
CONFIG_TINYPY = Y
CONFIG_PICOC = n

So, make sure you have installed the gcc 4.7.3 otherwise TCC will not compile

Before I go any further what camera are you trying to compile for ?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Mayo on May 23, 2013, 03:08:34 PM
Thanks :)

I compile for 6D.

I figured out the CONFIG_XXXX stuff. raw_rec.mo compiles now.

I'm now trying to figure out how to compile raw2dng (the makefile apparently uses mingw, so i'm doing this now).
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 23, 2013, 03:19:41 PM
to get the latest raw2dng.exe just downloaded from here.
https://bitbucket.org/hudson/magic-lantern/downloads
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Mayo on May 23, 2013, 03:23:30 PM
Yeah, but I want to modify it, to add support for 10bit and 12bit raw. Almost done ;)
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: dngrhm on May 23, 2013, 04:06:50 PM
Any idea why building is failing for me?

Makefile.user: http://popspring.com/mldrop/Makefile.txt (http://popspring.com/mldrop/Makefile.txt)

Output: http://popspring.com/mldrop/mlfail.txt (http://popspring.com/mldrop/mlfail.txt)

I didn't see this answered.  I had the same problem compiling on Mac OS X 10.8 using yagarto with version 4.7.2 for 650D with (CONFIG_CONSOLE = y CONFIG_TCC = y CONFIG_MEMCHECK = y CONFIG_MODULES = y CONFIG_PICOC = n).  The error is saying there is no definition for an abort function, which is defined in picoc, but we are excluding that.  The work around I found by googling and searching the forum a bit (to substantiate, not blame for not searching enough) was to add a dummy abort function.  I created a file in the src dir named dummy.c containing the following code:
Code: [Select]
void abort () {return;}I then added dummy.o to ML_EXTRA_OBJS in the Makefile in platform/650D.101.  I'm not sure if this is the correct way to handle this or not, but it worked for me.

I just thought of this as I was looking up the 650D Makefile.  It may be that I'm using and old version of Makefile.user in the top-level directory.  You could try updating from the default and see if that helps.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: 1% on May 23, 2013, 04:58:12 PM
Quote
the makefile apparently uses mingw, so i'm doing this now).

Only on wintel
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: CarVac on May 27, 2013, 09:07:57 AM
REPOSTED (upon request) from raw video post-processing thread:

I may be the only Linux user asking for help but...

I couldn't get the bash script to run; it complained that there was no "raw2dng".

So I realized I needed that program, but when I tried to compile it it needed two headers.

So I grabbed both headers and the makefile and modified the .c file to not look two directories up for the other header, and it still didn't compile.

Then I decided to clone the whole ML Unified branch and build that, but then I realized I needed the gcc-arm-none thing and got that.

Then, it started to compile, but it stopped:

boot-hack.o: In function `my_init_task':
boot-hack.c:(.text+0x544): undefined reference to `_bss_end'
boot-hack.c:(.text+0x548): undefined reference to `_text_start'
boot-hack.o: In function `my_task_dispatch_hook':
boot-hack.c:(.text+0x5f8): undefined reference to `_task_overrides_start'
boot-hack.c:(.text+0x5fc): undefined reference to `_task_overrides_end'
boot-hack.o: In function `copy_and_restart':
boot-hack.c:(.text+0x7e4): undefined reference to `_bss_start'
boot-hack.c:(.text+0x7e8): undefined reference to `_bss_end'
boot-hack.o: In function `my_big_init_task':
boot-hack.c:(.text+0x8d0): undefined reference to `_init_funcs_start'
boot-hack.c:(.text+0x8d4): undefined reference to `_init_funcs_end'
boot-hack.c:(.text+0x8e8): undefined reference to `_tasks_start'
boot-hack.c:(.text+0x8ec): undefined reference to `_tasks_end'
config.o: In function `config_parse':
config.c:(.text+0x2b8): undefined reference to `_config_vars_start'
config.c:(.text+0x2cc): undefined reference to `_config_vars_end'
config.o: In function `config_save_file':
config.c:(.text+0x440): undefined reference to `_config_vars_start'
config.c:(.text+0x444): undefined reference to `_config_vars_end'
config.o: In function `get_config_vars_start':
config.c:(.text+0x538): undefined reference to `_config_vars_start'
config.o: In function `get_config_vars_end':
config.c:(.text+0x544): undefined reference to `_config_vars_end'
config.o: In function `config_var_was_changed':
config.c:(.text+0x590): undefined reference to `_config_vars_start'
config.c:(.text+0x594): undefined reference to `_config_vars_end'
config.o: In function `config_var_restore_default':
config.c:(.text+0x5dc): undefined reference to `_config_vars_start'
config.c:(.text+0x5e0): undefined reference to `_config_vars_end'
property.o: In function `prop_add_internal_handlers':
property.c:(.text+0x1d0): undefined reference to `_prop_handlers_start'
property.c:(.text+0x1d4): undefined reference to `_prop_handlers_end'
collect2: error: ld returned 1 exit status
make[1]: *** [magiclantern] Error 1


Did I try the right things?

How can I get raw2avi to work on linux?

I'm running Ubuntu 13.04 here, and I don't want to dig out my Windows laptop to do this.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: DjJuvan on May 28, 2013, 08:18:29 PM
I don't know if this was mentioned before, but I have a suggestion to add a feature for "backup files" from CF to SD card. This could be very useful if you don't have a lot of high speed CF cards, but you have a lot of SD card storage and you can simply backup everything on this cards. It would take a while to transfer, but it's better than be stuck outside and don't have any other option. ^^'
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: leefie on May 29, 2013, 06:53:57 AM
600D / T3i / Kiss something something  :P
I can't get the raw video to create files.
I have 2.3 plus the nightly build (5-29-13) plus the Tragic Lantern build (800 Fileman)
I keep getting "File Create Error" and record doesn't run. I can shoot regular ML video no problem.
I have a fast card (Sandisk Extreme Pro 10).
I've turned off all enhancements and ML options except raw video and set the size to the minimum.
I've also changed RAW to sRAW in the shoot menu.
But just can't get it to shoot video :-(
Have I missed something obvious?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: xNiNELiVES on May 29, 2013, 07:23:56 AM
Yeah, but I want to modify it, to add support for 10bit and 12bit raw. Almost done ;)

Thank you for working on this!
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: nanomad on May 29, 2013, 07:34:50 AM
status
make[1]: *** [magiclantern

Did I try the right things?

How can I get raw2avi to work on linux?

I'm running Ubuntu 13.04 here, and I don't want to dig out my Windows laptop to do this.
Make clean and rebuild. It will magically work
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: greeches on May 29, 2013, 10:23:38 PM
I get the module loaded, and the RAW recording menu option is available.

When I hit the "styles" button to setup the recording dimension, I never see the "Start" option and I have small blue dots by the resolution and other options.  When I hit "Live View" it takes me to live view with a box around the resolution I"ve selected.

It never records the raw images.  If I hit record button, it takes h.264 video.

How do you start recording? 

5Dmk2
ML v2.3NEXT
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on May 30, 2013, 03:02:17 AM
I get the module loaded, and the RAW recording menu option is available.

When I hit the "styles" button to setup the recording dimension, I never see the "Start" option and I have small blue dots by the resolution and other options.  When I hit "Live View" it takes me to live view with a box around the resolution I"ve selected.

It never records the raw images.  If I hit record button, it takes h.264 video.

How do you start recording? 

5Dmk2
ML v2.3NEXT

1. Right question wrong Board-
2. Search before you Post
3.  Read:
How to record: -- RAW VIDEO ON 5D3 -- 
http://www.magiclantern.fm/forum/index.php?topic=5451.0
.. I know it is not for 5D2 but the ML menu should be similar....

Short Answer:  I think you have not loaded the RAW video module.

The Bad News.  You have read the Forum rules so you are getting a warning.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: dandeliondandy on May 30, 2013, 07:12:47 AM
You're actually probably using the module that records by pressing the joystick-like button near the top right of the screen. That's currently what starts and stops the recording, not the LV button or a "start" in the menu, like it used to.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: joshmonie on June 02, 2013, 05:04:53 PM
Hi Guys,

I just want to get it out there that I'm a total newb before I go any further.

Ok, I'm needing some help on installing this all on my 5D2. As far as I'm aware, I download the current stable ML which is v2.3, unzip it and take just the 5D2-212.fir onto the root of my CF. Where do I find the autoexec.bin and ML folder? Can I just use the autoexec.bin and ML folder from a previous build and copy/paste the raw_rec.mo file into where it should be?

I was going to try this but was worried I'd brick the camera so thought I'd get some expert advice first!

Thanks in advance,
Josh
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: tjobby on June 03, 2013, 11:22:16 AM
Hello

I have installed ML and the raw video. I can record Raw video and i can see that it is counting the frames. I can see the video i playback under raw in the ML menu.

The problem is that i can not see any of the files that i recorded in windows when i plug the camera ind with USB. I can see the card is not empty but there are no files under DCIM.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: lourenco on June 03, 2013, 01:14:32 PM

The problem is that i can not see any of the files that i recorded in windows when i plug the camera ind with USB. I can see the card is not empty but there are no files under DCIM.

I normally use a memory card reader to pull the files off the memory card directly. The camera only has USB 2.0 while my card reader is USB 3.0.  I just plug the camera into the computer. I notice it does not show the raw movie files. I am sure it does not show the file given the file type being  raw and not a actual picture. The memory card reader can see all the files fine. I would recommend buying a memory card reader. USB 3.0 if you have USB 3.0 on  your computer. Makes a difference if you have a fast memory card.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: squig on June 03, 2013, 01:19:53 PM

The problem is that i can not see any of the files that i recorded in windows when i plug the camera ind with USB. I can see the card is not empty but there are no files under DCIM.

Doesn't work, even if it did it would be painfully slow. You have to use a card reader.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: RenatoPhoto on June 03, 2013, 01:43:02 PM
I was going to try this but was worried I'd brick the camera so thought I'd get some expert advice first!

The experts are doing development work so please read:

RAW video & ML -- Beginners Guide, FAQ & Useful Links -- READ FIRST
http://www.magiclantern.fm/forum/index.php?topic=5520.0;topicseen
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: tjobby on June 03, 2013, 02:13:50 PM
Doesn't work, even if it did it would be painfully slow. You have to use a card reader.

Thanks a lot. Never got a reason for a card reader until now. I just bought one and it worked! Thanks a lot.

Why would it be slower through the camera?
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: arian_dd on August 20, 2013, 09:18:03 PM
The experts are doing development work so please read:

RAW video & ML -- Beginners Guide, FAQ & Useful Links -- READ FIRST
http://www.magiclantern.fm/forum/index.php?topic=5520.0;topicseen

The link to "lourenco" 's compiled version of ML for 5D mk III on google drive is empty. Can anyone help me find the latest version of the raw-rec module for 5D mk III? I don't need the 14 stop dual ISO raw feature yet. Thanks.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: aargento on August 23, 2013, 06:58:01 PM
Updated build for 5D3 as of August 21st. Note this only supports 5D3 with 1.1.3 firmware.
https://drive.google.com/folderview?id=0B7QlH_BH2m32Nm9hVHZpVlpCWU0&usp=sharing
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: prabhath.mp on October 05, 2013, 11:52:31 AM
Hi All,

I just installed the RAW firmware for 550D and I was trying to find a way to decipher the RAW file on Windows 7 and Ubuntu 13.04.

On Windows 7 I installed RAW2DNG.exe but could not find a way to decipher it. When I click on the app, it just runs in Command prompt and closes away in snap.

Could you please let me know if I am doing anything wrong?

Is there any documentation that I could refer? :)

Thanks so much for all your efforts in creating such a beautiful firmware.

Cheers,
Prabhath MP

Bangalore, India
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: prabhath.mp on October 05, 2013, 12:17:13 PM
Hey All,

I found the answer by searching for some information on YouTube :)

http://youtu.be/7UxwA-YUC4U

Thanks so much.

Cheers,
Prabhath MP
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: teakwood18 on October 08, 2013, 09:40:00 PM
I cant get the Raw_Rec to load.  Am i missing something. Its loaded before, Before my original card(KBay) crashed.  When i tried today arkanoid came up figured out where the module for raw was but it never gave me the raw video any suggestions for what im missing this time around
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: Walter Schulz on October 08, 2013, 10:00:26 PM
Put card in cardreader, format with NTFS, put it in cam, format it there and start again from scratch.

Ciao
Walter
Title: playback sound on camera from raw files no sound
Post by: Bugsy on August 16, 2014, 06:20:34 AM
Hi Folks
    Well I arrive to record  on raw files but When I playback the raw video on camera no sound at all and Second problem: the video playback  is always  in slow motion even if you switch to exact video option it goes  so fast so at the end never play the right  way maybe in post processing with raw2dng I never try it  SOMEBODY KNOWS about this details.....
Thanks
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: dpjpandone on August 16, 2014, 06:35:02 AM
you are correct, camera is too slow to playback in real time, and adding sound playback would make it even slower. MLRAWVIEWER is an excellent program for reviewing files on set.
Title: Re: RAW Video Module raw_rec [Compiling/Installation]
Post by: atideno on November 19, 2014, 02:15:58 PM
how do use the new dng2raw (raw2dngOSX)?
i cant just drag and drop files any longer ?