Menu

Show posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.

Show posts Menu

Messages - reddeercity

#1
So what happen here ? I'm lost can't even found the latest posts it's so out of place even going to desktop version doesn't help . I hope the old site is coming back soon. Even searching window I can't found this deftly is going to put a damper on my work in general sorry don't mean to be negative here but "it it's not broke don't fix it" so was there a problem with the old site?
And what with the "I agree" thing when I logged in ? It doesn't even give the terms of the agreement so what I'm I Agreeing too here ?
#2
Just for kicks i try to build the 50D & 5D2 with @names_are_hard  magiclantern_simplified but failed tried comment the error but make it worse  :(
here a few screen shots . Do i need to update my Linux ? to the what is being used by you ? will i have problem compile my crop_rec builds ?
Anyways here the screen shots :

5D2
 
50D
#3
Ok trying to compile , getting a error , but i don't know how to solve , Just compile the module by it self not a full build
did some warning but that's to be expected , being code from the old core.

#4
Quote from: names_are_hard on February 15, 2024, 04:57:11 PM
Thanks, I understand what's going on now.  ... I assume the intent was to learn what control was possible over CF cards, then make nicer (and importantly, smaller) code to do the parts we care about.
Yes that's right , i hope to learn where the timing control regs are to manually enable UDMA 7 plus maybe bypass some canon routines to limit the overhead.
Quote from: names_are_hard on February 15, 2024, 04:57:11 PM
.... I've removed the linux specific stuff, here: https://github.com/reticulatedpines/magiclantern_simplified/tree/hdparm_hack
Thanks , i'll give it a try
Quote from: names_are_hard on February 15, 2024, 04:57:11 PM
That should build more easily.  Because it's based on my repo, you can use a more modern linux. 
I recommend Debian Testing.  It might not work on whatever old linux you're using, mainly because we converted everything to python3. 
Try it and see if you want.
Ok , I'm on Ubuntu 18.4x something , it use gcc arms 5.3 i think.
Quote from: names_are_hard on February 15, 2024, 04:57:11 PM
I haven't tested the code in any way.  Will it destroy your cam?  Maybe!
"With Great Risk Comes Great Reward"
at least that's what they say :D
I'll more then likey try it on my 50D first ! , just in case something goes south  :P
only paid $150 5 years ago , that may sacrificial lamb
#5
Quote from: Walter Schulz on February 15, 2024, 07:58:19 AM
Found a piece of contradicting info claiming UDMA-5, 6, 7 all using 3v3.
I found in the documents that the CF cards  are 5v tolerate 
https://www.transcend-info.com/support/product/memory-card/compactflash-1000#SpecificationsModal
says there cards are 3.3v & 5V , i think the 5v is from the older ide PC interface like cd roms & 3.5' floppy disc etc. ....
when CF cards where used for backup soooo long ago  :P
#6
@ names_are_hard
Here other post that references cf card sppeds & cf_acc hdparm
CF Card Info screen shot https://www.magiclantern.fm/forum/index.php?topic=19336.msg207054#msg207054 ,
a1ex links the "hd_parm" build https://www.magiclantern.fm/forum/index.php?topic=19336.msg207053#msg207053 ,
direct reg for UDMA7? https://www.magiclantern.fm/forum/index.php?topic=19336.msg207128#msg207128 ,
some useful info , its where i got the idea to over clock the CF card bus from a1ex https://www.magiclantern.fm/forum/index.php?topic=12862.msg199697#msg199697
From a1ex on cf speed & overclocking
QuoteI was doing sector-level benchmarks with Canon routines from bootflags.c, filling the entire card with 0xFFFFFFFF, 0x00000000, 0x55555555, 0xAAAAAAAA, 0x5A5A5A5A etc,
to see if that makes any difference in benchmarks. It didn't, but some blocks were written at ~120MB/s, others at ~85MB/s, and a very small percentage of them were written at lower speeds.
That pattern wasn't exactly repeatable, but the histograms were pretty much the same .....
Quote@reddeercity: more details after I'll get a new card (it *is* possible to overclock the 5D2 CF interface).
https://www.magiclantern.fm/forum/index.php?topic=12862.msg199759#msg199759 a1ex quoted"You can send ATA commands to the CF card (QEMU emulates them), so if the only difference between UDMA 6 and 7 is timing, it might even be possible to put the card in UDMA7."
#7
Quote from: names_are_hard on February 14, 2024, 10:36:51 AM
Sorry, I missed some of this as I was busy with digic 7 raw video.
No worries , raw video on D7 that great !!  8)
Quote from: names_are_hard on February 14, 2024, 10:36:51 AM
You definitely don't want "LINUX_PATH=$(HOME)/src/linux-3.19".  That's just wrong.  Can you link to the source for this module?
Ok , i found the source I'm using in foss.heptapod.net
Here's the link to the module , it looks the same as my source i downloaded about 4 years ago
cf_acc hdparm
#8
Ok I thing i figured this out , i need to put the Linux parts in my "Path" for compiling .
Been learning all about the "Linux Path" environment for developing, etc. .....
Finally found a list of command for terminal command line , it's really not that different then old DOS or 4DOS  :)
It all coming back now  :D , had to deep dive in to the "Path" stuff now i can move on and make some progress .
#9
Did a search for all references to "linux" in the "cf_acc module to see what its calling etc. ....
hdparm-ml-shim.c:
  7: #include <linux/types.h>

Makefile:
   9: LINUX_PATH=$(HOME)/src/linux-3.19
  13: CFLAGS += -I$(LINUX_PATH)/arch/arm/include/uapi
  14: CFLAGS += -I$(LINUX_PATH)/arch/arm/include
  15: CFLAGS += -I$(LINUX_PATH)/include/uapi
  16: CFLAGS += -I$(LINUX_PATH)/include
  18: # fixme: properly handle generic-y from Linux makefiles
  20: CFLAGS += -I$(LINUX_PATH)/generic

hdparm\hdparm-routines.c:
  6: #include <linux/types.h>

hdparm\hdparm.c:
    27: #include <linux/types.h>
    28: #include <linux/fs.h>
    29: #include <linux/major.h>
   825: * The Linux kernel IDE driver (until at least 2.6.12) segfaults on the first
   830: * We would like to issue these commands consecutively, but since the Linux
  1632: " Due to bugs in older Linux kernels, use of these commands may even\n"

hdparm\hdparm.h:
  91:  * instead of using the system def from <linux/fs.h>

hdparm\identify.c:
  7: #include <linux/types.h>

hdparm\sgio.h:
  3: #include <linux/types.h>

Or should just comment out all these references ?
#10
Making some progress i guess , got it to compile . Took the cf_acc module code and put it in my new crop_rec source that seem to work until it didn't .
Got a error i had years ago when i was working it activity , didn't understand the problem then but i think I understand now but don't know how to solve.
Here what i got so for see image below:



so its looks for <linux/types.h>
and there's nothing in the magic lantern source , then i looked in the "Makefile" in the module and found this
# define the module name - make sure name is max 8 characters
MODULE_NAME=cf_acc
MODULE_OBJS=cf_acc.o hdparm/identify.o hdparm/hdparm-routines.o hdparm-ml-shim.o

# include modules environment
include ../Makefile.modules

LINUX_PATH=$(HOME)/src/linux-3.19

CFLAGS += -Ihdparm
CFLAGS += -Idietlibc/include
CFLAGS += -I$(LINUX_PATH)/arch/arm/include/uapi
CFLAGS += -I$(LINUX_PATH)/arch/arm/include
CFLAGS += -I$(LINUX_PATH)/include/uapi
CFLAGS += -I$(LINUX_PATH)/include

# fixme: properly handle generic-y from Linux makefiles
# (hack: copy and rename folders around manually)
CFLAGS += -I$(LINUX_PATH)/generic

test: FORCE
gcc hdparm-test.c hdparm-ml-shim.c hdparm/identify.c hdparm/hdparm-routines.c -Ihdparm -o hdparm-test
./hdparm-test


So it needed something from Linux or it needs the uapi from arms ? i don't understand this never seen this before , something a1ex needed to run
the overclocking on the cf card . i hope somebody could enlighten my please , I'll do more research in the mean time.
:D
#11
@names_are_hard , thanks , glad to be back .
I guess Discord just sound unappealing , having to join a different forum/chat , as I'm not very good at chatting/typing fast/spelling  :D
Take me forever to type up these posts on magic lantern (spell checker etc. ...)
I have dyslexia so it's a challenge but funny thing about It I have no problem with reading & write code (go figure) .

Quote from: names_are_hard on February 03, 2024, 03:20:59 PM
If I posted all my small findings to the forums it would be useless spam. ...... We treat Discord as useful for quick discussion, but useless as an archive, so we document things properly on forum and in the repo.
Ok I don't know that , I've always found all the info needed here on the forum for the stuff I did in crop_rec , Actually a lot of information came from
[CMOS/ADTG/Digic register investigation on ISO] and others related.

I've being reading all of your posts of late & have tried to keep up with the 200d from you(great work) .
I actually was very interested in the 5D4 (D6) a few years back but the cost was just too much , even today these still around $2,000.0 (Canadian) used.

So 2 Thing that really brought back to do more work was 1st: Heder 7DMrk2 work simple great work at getting access to the raw stream & the different ways he achieved it plus
the quick access to the system Then he summarized on how it was done . Besides that the 7D2 Mrk2 is a very good cam 3x3 liveview no line skipping , clean HDMI with audio & 3K 5x zoom
I would say it may be better then the 5D3  ;D specially it raw vide is fully functional .Oh yea it a lot cheaper too , I can pick one up used from camera rental store for $599.00 (Canadian).

The second thing that got me back was when to posted in the ResLock thread https://www.magiclantern.fm/forum/index.php?topic=6740.msg245655#msg245655
got me thinking about 5D2 address's,  so I was Hooked again! I have a need to finish this plus a few more thing I would like get working if possible
E.G. MJpeg 4.2.2 (color space) (AVI) compression (same as 1DC)
Change the Uncompressed liveview stream from 4.2.2 to 4.4.4 also if its in the Jpeg encoder chip change liveview from 8bit to 10bit .
I do know the HDMI has 3 different color space out put , ok 4 their a 4th "Unknow color mode" maybe Linear color similar to EXR's or DPX's files or the Raw color space .
Something to need to used a 2.20 lut curve to see the image etc. .....
here a short summary out of the 5D2 rom disassemble , just did a "HDMI" search with visual Studio on win7
475223: "Pana_TurnOnHDMI (Audio = %d)":
   475247: "Pana_TurnOnHDMI : EDID_COLOR_444":
   475257: "Pana_TurnOnHDMI : EDID_COLOR_RGB":
   475267: "Pana_TurnOnHDMI : EDID_COLOR_422":
   475277: "Pana_TurnOnHDMI : Unknown ColorMode (%d)":
   475289: "Pana_TurnOnHDMI : FULL_HD_50":
   ....................
   475417: "Pana_TurnOnHDMI : FULL_HD_60":
   475426: "Pana_TurnOnHDMI : DEFAULT_NTSC":
   475435: "Pana_TurnOnHDMI : DEFAULT_PAL":
   475444: "Pana_TurnOnHDMI : Unknown VideoCode (%d)":
   475457: "Pana_TurnOnHDMI : Av_hdmi_avreq_init failed":
   475469: "Pana_TurnOnHDMI : End":


I would like to get in to the Jpeg chip , on the 5D2 its the JP62 if I'm not mistaken , there so much I thing in there that would help us .
I could go on and on , time to get back to it  :)
#12
Quote from: heder on February 02, 2024, 09:15:37 AM
Yes, come back and help lighting up the development  :)
I do my best  :)
I'm in catch up & refresh mode , being a while starting to get my head around everything .
Quote from: heder on February 02, 2024, 09:15:37 AM
Doing this right now , thanks its coming back to me now .
#13
After seeing considerable work on D6 (7d mrkii heder)  &  D7& D8(names_are_hard)   8)
Its inspired me to finish some unfinished magic lantern business on the 5D2 & 50D
I find that i have some free now (6-8 weeks , after that Drag racing Season(ProMod's) start around Mid May (canada)
being i build race car chassis & parts (I'm in the metal fabricator business) i need to be at the track & late nights in the shop  :)

Anyway i'm going to take a stab at CF card over clocking first, I have all the code (thanks a1ex!) and it work on the old
ml core platform (.raw video) optimize for D4 cams with no restrictions on performance , That not why I'm using the old core ,
mainly because it work or should i say it will once i can compile it , then i can that the info and implement it in to the newer core that
D4 works on crop_rec, if i can get the CF card controller to switch to UDMA 7 from UDMA 6 i should go from 80-85MB/s to 120MB/s or around there.
But here lay the problem , see screen shot , how do i add "gcc 4.8.3 or check for it , i'm on Ubuntu Bionic 18.04
I do all my crop_rec development with it so no issue there just this old core stuff ,
do know for a fact that a1ex had it working on the 5D2 in the very early days of ML


Any help or advice would appreciated , i'm not big Linux user mainly PC(windows7 some windows 10 if i have to)
and some mac. its been about 3 years since i did any development so just need some refreshing  :D

A few other things i what to finish/complete on 5D2 & 50D
Compressed 14bit raw (I now know what the problem is "ResLock address issue" 5d2 would lock up on saving the compressed raw so
I've already had it running serval years ago but drop it because i couldn't find the issue .
a fully funtional 1x3 crop_rec perset without adtg_gui module, the problem is the adtg reg are not applying for pixel binning "more then likely just a coding problem" I'm not a professorial coder , but i can get by.
Better Preview in crop_rec & general code cleanup (sometimes there a race condition in crop_rec between 3x1 4k (4096x590->4096x1770 2.3AR)
and High speed frame rate 1x1 48FPS 1880x774 .
Just for the 50D :
Get the ADTG Reg to apply , seems to be a problem on D4's ? or my code .
In crop_rec on 50D i can get 3760x1080 , the problem is the vertical , I need to have an ADTG reg applied to get a full vertical
(5d2 dosen't have this more then likely because it all ready does video out of the box)
the 50d never had Video even thou it was always there , Magic Lantern code enabled it so crop_rec (5xzoom) was always limited to 1080 vertical
until i found the Reg (only but luck) so i do 1x3 on 50d but i need to fix the ADTG reg first then everything will fall in place fast on the 50d.

That all for now , i hope all development continues on the forum for everyone to see publicly , i don't like when the ML discussion is behind closed doors
that one of the reason i stop doing any development , even thou the development is on D6 ,7 & 8 it still helps me a lot discover thing on the D4 cams.
#14
Reverse Engineering / Re: ResLock stuff
January 11, 2024, 06:00:21 AM
This sound like the same issue with the 5D2/D4 , it would crash on the ResLock stuff
I can get a compressed image in Liveview (Photo or Video) but lock's up on saving.
I always thought that there something not right on D4 ResLock, at the time even a1ex was or still stumped .

Anyway good to see some work here,  its starting to help me understand where the problems are.
I'm digging around the information and see if i can finish compressed 14bit raw on 5D2 & maybe 50D too since there so closely related.
I do have so old research in to ResLock stuff i think may still have some logs , I had a trace capture log for the first minute or two
so i could took a CR2 & or shot H264 .mov file and trace the events on the log.
I see if i still have them , thou no sure if it will help from D4 .

Edit: Found 2 trace logs 5D2 (CR2 Photo & H264 .mov compression ResLocks)
dm-0001_cr2_2018_2_12.log
5D2_Trace_log_h264_compression_ResLocks.txt
#15
The way i used my 5D2 to get properly framing , was to use the Zacutro  Z-Finder Pro 3X , that passes thought to my
Atomos Ninja Hard drive recorder(which can be a monitor as well) . The Zacutro has different framing guide lines plus does
Anamorphic ,  be on that I my be the only left here that did research on the 5D2 Rom , the possibility exists but highly unlikely .
Its a matter of mirroring the liveview but the big differences here on the 5D2 you have 2 different Image streams
1 is set to 3x4 aspect ratio (HDMI with black pillar blocks) & the other (Video) is 16x9 or(1.85x9)
Now if we could get rid of the pillar blocks on the side , that would be 1 step closer to mirroring .
The graphic has to be redraw on both screen at the same time and i don't the D4  5D2 has a fast enough image processor .
I've done a lot Hdmi research about 5-6 years ago but ran in to a lot of brick walls .

The easiest way is to buy 5D3 , or the way i describe on my 5D2 .
#16
Raw Video / Re: Looking for 3x1 samples (any camera)
September 17, 2023, 06:20:33 AM
I have a sample for you , 3x1_5DMrk2.zip
Its a single frame Dng 4064x590 3x1 .
I'm the first one to implement 3x1 in crop_rec .mlv 10,12,14 bit uncompressed after A1ex of course in the 5D2 D4 cam
i write the code for 3x1 @24fps (4064x590) in my crop_rec for 5D2 D4 here are the builds 3K/UHD 5D2 Raw development and Other Digic IV Cams

In the Zip there is 1 dng(4064x590) ,2 Tiff created in After Effect with Camera Raw , 1 is the original size 4064x590 & the other is full size 4064x1770
3x1 is as good as 1x3 , its just how you used it ! it shines at close ups where sharp angles don't give artifacts , but if you do record strips etc. ....
then it breakdown a bit . No different then using 3x3 on all the cam ml supports (not including 5D3 it doesn't do line skipping)
because the 5D2 has a very big sensor 5.7k is does a superior job over the smaller 4.5-5k sensors , full frame is always better
and the color science is different then the D5 cameras 5D2 is more Log like . So color science play a part in 3x1 , anyway that my 2cents  :P
 
edit: its also how you process the file , i only use Adobe After Effects with Camera Raw processing , it the only way to go
with the 5D2 files, all the other apps don't reproduce the full range of colors , there always is something off like a green tone WB shift but not
in Adobe products ,
#17
nice A.I. response , who talks like that ?
I started using Magic Lantern (2011 i think or 2012) not for Raw Video , but for Clean HDMI feed and all the feature that make a Picture camera
in to a Video/Film camera (i think everybody knows what i'm talking about)
and with technicolor cinestyle picture profile i was in heaven !! and with the H264 bit rate controller
I was getting over 75Mb/s H264 video in cine log image , as long as you expose the image correctly
you had a amazing image that hold up even today , there said when the Japanese engineers first
saw "Vincent Laforet"  "Reverie
There all had tears in there eyes , the engineers where so moved !
https://www.youtube.com/watch?v=UPh4sy4shMI

https://en.wikipedia.org/wiki/Canon_EOS_5D_Mark_II#Independent_film_and_television
just a small list of what the 5D2 did without raw video in film & video production
and some i bet where using ML

Magic Lantern Can Be for everyone its really that easy , but you can make it as hard as you what
it all depend what you are liking for, if you what Raw Video like a "RED" or "Arri Alexas" then you must
be prepared for some work & new learning curves , if not use a Iphone  :P   

edit:I usually read the forum 2-3 time a week so i can keep up  :)
#18
Will i have some experimental code for the 5D2 D4 back when raw video was just a thing starting and not easy recorded by 5D2
(5D3 wasn't even out yet , so the 5D2 was the best at the time with no equal)
always i have code that "Hard Coded" 12bit from 14bit  in camera for raw video so no hardware (encoder chip) like there is now.

code released on May, 23, 2013
raw_rec.c

static int buffer_size_compressed = 0;
static int raw_bitdepth = 12; // make it an option in raw menu and export in raw footer?

extern void raw14_to_raw12(void *buffer, int size);
extern void raw14_to_raw10(void *buffer, int size);




if(raw_bitdepth==12)
{
buffer_size_compressed = (size_used * raw_bitdepth) / 14;
raw14_to_raw12(ptr, size_used);
written += FIO_WriteFile(f, ptr, buffer_size_compressed);

}

raw2dng.c

if(raw_bitdepth==12)
{
struct raw12_pixblock * p = (void*)raw_info.buffer + y * raw_info.pitch + (x/8)*12;
switch (x%8) {
case 0: return p->a;
case 1: return p->b;
case 2: return p->c_lo | (p->c_hi << 4);
case 3: return p->d;
case 4: return p->e;
case 5: return p->f_lo | (p->f_hi << 8);
case 6: return p->g;
case 7: return p->h;
}
return p->a;
}

struct raw_pixblock * p = (void*)raw_info.buffer + y * raw_info.pitch + (x/8)*14;
    switch (x%8) {
        case 0: return p->a;
        case 1: return p->b_lo | (p->b_hi << 12);
        case 2: return p->c_lo | (p->c_hi << 10);
        case 3: return p->d_lo | (p->d_hi << 8);
        case 4: return p->e_lo | (p->e_hi << 6);
        case 5: return p->f_lo | (p->f_hi << 4);
        case 6: return p->g_lo | (p->g_hi << 2);
        case 7: return p->h;
    }
    return p->a;
    }

no sure this will help you ,  i have the full "C" code for
raw_rec.c
raw2dng.c
chdk-dng.c (this is for dng writer for the hard coded 12bit on 5d2
a old developer "Mayo" was or is the author of this code , if you would like all of the code let my know & I'll
post a link to the full code.
#19
Quote from: names_are_hard on September 10, 2022, 09:31:51 AM
Quem is typo of qemu.
......
Fundamentally, he's saying that since you don't understand why it works, you can't know if it works safely.  Which is a reasonable argument.
sorry I have dyslexia  :-[
Exactly!! :D
I'm using a1ex's locgic here , that the same argument he would make when many people come up ways of doing things that
couldn't be explained "just work when you set xxx parameters in the reg's"  will that didn't fly with him until it was understand fully.
Case in point the compressed raw , it was known about almost right from the beginning but it was a blackbox "still is to a certain extent"
e.g. 4.2.2. MJpeg (AVI) it there ,only cam to show promise so far (40D) , i have being poking at it for years so i hope 40D MJpeg development continues
once it work ok then i'll  try to get it on 5d2 & 50d . (I don't have time to do reverse engineering anymore but i do have some time that i can code it to
5d2 &50d.
I could go on & on about examples of short cut that have some success in certon fearture but at best there posed a dangerest risk
and I don't what to be that guy that coded a short cut that caused damage or just simple Softbreak the cam. 

Just trying to promote safe reverse engineering & coding  :)
#20
Raw Video / Re: Canon t2i 12bit or 10bit?
September 10, 2022, 06:42:15 AM
Ok , looks like i have found it .
10bit_12bit_raw_twk_crop_rec.2016Dec01.550D109.zip
No Charge Free as the birds  :P
#21
Raw Video / Re: Canon t2i 12bit or 10bit?
September 10, 2022, 06:30:37 AM
I have it i do believe , have to look for it in my achieve of magic lantern old files
in fact i usually keep D4 developments builds and Log files and any reverse engineering
Maybe i should charge for it ?  :P
it seems to be acceptable now days to charge for what is normally free
#22
Quote from: theBilalFakhouri on September 10, 2022, 03:20:28 AM
For Devs: The Magic Trick has been revealed, is it risky?

Yes , did you check it in quem? you don't know for sure what going on so , it just a "poke in the dark"
and you got lucky until someone burns up there cam. In my opinion you need to find out what going on , a very good way is Log files
with I/O trace build , it log all activity for 30 to 60 seconds can't remember right now .
That how i got crop rec ,Liveview , High frame rate(48fps FHD) 3x1 5k & 4K full res. to work on 5d2
and crop_rec on the 50d . Plus including the very early compressed raw on d4 cams , there's just no other way to be sure.

My 2 cents

#23
Raw Video / Re: What are you using to play mlv?
August 28, 2022, 07:54:54 AM
@theBilalFakhouri did you "run as Admin" ?
I'm on win7 right now ,
run ffmeg play .exe in comparable mode , from right click choice run in comparable mode , e.g. run in Win8 mode etc....
#24
Raw Video / Re: What are you using to play mlv?
August 28, 2022, 07:49:23 AM
I don't have compressed raw files just uncompressed 10,12 & 14bit , just in case this is the issue with ffmeg .
It may not support canon raw compressed raw files .
#25
Raw Video / Re: What are you using to play mlv?
August 28, 2022, 07:32:48 AM
here the dowlnload link i use
https://mpv.io/
just drop and drag MPV icon , just tested with a old 14bit mlv from my 5D2

Edit: I just downloaded the new ffmpeg
http://ffmpeg.org/download.html#build-windows
https://www.gyan.dev/ffmpeg/builds/ffmpeg-release-full.7z
once you extcact it make sure you "Run as Administrator" FFmeg.play
then just drop file on the .exe , once a again i used a 14bit mlv from my 5d2