Author Topic: Raspberry Pi High Quality Camera  (Read 2173 times)

garry23

  • Contributor
  • Hero Member
  • *****
  • Posts: 1981

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #26 on: May 17, 2020, 08:14:48 PM »
Technical specs are fine and dandy but so far nobody posted any decent looking raw video from these in at least HD resolution.
There are some CCTV cameras that use dual exposure that are more exciting for me achieving over 14 stops easily but they only sell with subscriptions when i asked half year ago.

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #27 on: May 18, 2020, 01:57:05 PM »
I have one that I'm currently putting inside an old 8mm body - hoping to have it ready by the end of the week, so I can post some footage when it's all hooked up.

I could upload some footage already if you like, but it won't be anything more than a tripod shot filming a leaf or something... Also my knowledge of coding etc. is very limited. This is my first Pi project, so I don't know how useful I can be other than sharing footage.

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #28 on: May 18, 2020, 05:32:43 PM »
Great, please record in 24fps in highest resolution you can achieve, on infinity focus so we could check aliasing, so maybe some bricks and roofs and patterns from distance.
Also If You can upload some DNG frames , can be even one from 24fps clip.

juliagomez2244

  • New to the forum
  • *
  • Posts: 3
Re: Raspberry Pi High Quality Camera
« Reply #29 on: May 18, 2020, 08:20:34 PM »


[/quote]

Super cool this new camera I think the same as other colleagues, it will not be a device that will replace the DSLR but it looks very tempting to buy it, the technological future is getting better.
A few days ago I saw a film that was very futuristic in the technological field and I think we are going there, of course after we leave the covid-19

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #30 on: May 20, 2020, 09:07:54 AM »
Sorry it took a while, here's two test shots out my window. I'm really not sure how helpful these are as the only c-mount lens I have has sever blurring and CA especially on the edges. It's 25mm 1.4 which is very tele on this sensor. I tried it at a number of f-stops to hopefully give some variety in the detail. The issues mentioned above get worse the more you open up, and the more you close down the more ISO has to work, so I'm not sure what the happy medium is just yet. Hopefully there's at least 1 frame in here that can be of some use.

Anyway, here's the original files, which come out .264 and I also converted them to h265.mkv for easier viewing.

1920x1080
24p
mixed aperture f1.4 - f8(ish)
auto shutter speed
auto ISO
auto WB

https://www.dropbox.com/sh/seddezwwymwnh4v/AAAU5es-RCWOXCj1Fpkbz3Dba?dl=0

I'm planning to use this with D-mount lenses, but until I've finished my build, I have no way to mount them to test with nicer glass.

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #31 on: May 20, 2020, 11:41:08 AM »
Thanks, looks fine, can You output DNG files, raw files from it ?

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #32 on: May 20, 2020, 11:51:48 AM »
Premiere won't accept the .264 files, and I feel like taking a still from a converted file defeats the point right?

The originals are there, so feel free to take your own frames and stills.

I've not looked into taking a photo on the pi, but I believe they'd be jpeg.

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #33 on: May 20, 2020, 01:08:03 PM »
Im not sure You understand, we are excited about these sensors and cameras because of RAW capability, phones can record h.264 since over a decade, its very easy to rip out original lens and glue back C mount to every smartphone.
So You cant get RAW DNG frames from the camera ? Only h.264 ? Those are subsampled at 4:2:0 , nowhere near at what RAW is.

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #34 on: May 20, 2020, 02:21:39 PM »
Yes I get that, and I'm aware of how h264 is used. I highly doubt the camera will record DNG as a video stream, as there is a patent out stopping that from being possible. If you could record a DNG video stream, the biggest part of Magic Lantern, raw video, is already taken care of right?

The documentation says:

Picture formats               JPEG (accelerated), JPEG + RAW, GIF, BMP, PNG, YUV420, RGB888
Video formats               raw h.264 (accelerated)
10-bit RAW RGB data       Yes - format conversions available via GPU

I'm unclear as to what 'raw h.264' really means, but since it's not in a wrapper (mp4 / mov) I took that to mean it's as unprocessed as you can get. Would love to be proven wrong though.

Happy to do more testing, but I'm far from a coder, so let me know what to type into terminal and I'll report what happens. (No blowup codes please)

EDIT:
I've tried using some YUV commands which, as far as my understanding goes, should bypass any conversion. I'm unable to look at either a still or a video using this command though. I've added them to the Dropbox folder... again, if they're not helpful, let me know what else I can try.

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6438
Re: Raspberry Pi High Quality Camera
« Reply #35 on: May 20, 2020, 02:29:03 PM »
How can h.264 ever be raw  :P.

What does it mean? Some format available but how?
Quote
10-bit RAW RGB data       Yes - format conversions available via GPU

Edit: How to decode the h.264 files? Tried viewing but fails.

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7214
Re: Raspberry Pi High Quality Camera
« Reply #36 on: May 20, 2020, 02:49:54 PM »
How can h.264 ever be raw  :P.

Hi444PP profile does predictive losless coding. Don't know if it applies here.
Photogs and videographers: Assist in proof reading upcoming in-camera help!. Your input is wanted and needed!

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #37 on: May 20, 2020, 02:55:08 PM »
Edit: How to decode the h.264 files? Tried viewing but fails.

That's why I converted them to h265 :)

If you didn't see me edit above, there's a few more files in Dropbox.

I've also tried out a few 4x3 resolutions, since that's what I'll be shooting. The largest I could go with that is 1600x1200 - which is fairly reasonable. However I did read previously I should be able to get up to 30fps at 2028x1520, which would be really nice... so far it just gives me errors with that though.

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #38 on: May 20, 2020, 06:07:24 PM »
we have to get to that raw 10 bit rgb data stream and debayer it , maybe try some raw to dng converters
Digital super 8 eh? id do it too with this setup

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #39 on: May 20, 2020, 09:03:17 PM »
I've tried a few, like SlimRaw, but they're not recognising the file. I feel like it needs an extension, but it's anybodies guess as to what extension it needs. I'll keep reading about it and offer more footage as and when more info becomes available.

Digital super 8 eh? id do it too with this setup

Yeah, the sensor size is almost exactly the same as 8mm. and the Pi fits very nicely inside my (previously broken and unusable) Bolex B8.

EDIT:

You can playback the native pi files (that end in .264) in VLC - but I've not found any other app that can open them.

Interestingly, the app Scoop! has this to say about those files:

200520075652.h264
Format                                   : AVC
Format/Info                              : Advanced Video Codec
File size                                : 5.10 MiB

Video
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4
Format settings                          : CABAC / 1 Ref Frames
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 1 frame
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Color space                              : YUV
Chroma subsampling                    : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive

I don't know if any of that is useful to anyone, but it certainly can't hurt to post it.

2blackbar

  • Senior
  • ****
  • Posts: 348
Re: Raspberry Pi High Quality Camera
« Reply #40 on: May 21, 2020, 01:33:51 AM »
yeah post all findings, as you see its 4:2:0, typical smartphone vid specs

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2172
Re: Raspberry Pi High Quality Camera
« Reply #41 on: May 21, 2020, 01:45:06 AM »
@Anaconda_  , .h264 is a basic avc/mp4/mov without the wrapper of mp4/mov .
It's consider raw AVC , because of no wrapper . I've use this format many times in windows.   
https://extension.nirsoft.net/h264
That profile you posted is the same profile canon 5d3/d5 cams  .mov/avc use .

Luther

  • Senior
  • ****
  • Posts: 292
Re: Raspberry Pi High Quality Camera
« Reply #42 on: May 21, 2020, 02:17:30 AM »
The software a1ex posted before, raspiraw, added initial support for this camera's sensor:
https://github.com/6by9/raspiraw
https://github.com/6by9/raspiraw/commit/dbe1acf64cba221787080ad06f79d3a5bccd171a

Technically, it would be possible to record raw 24fps. RPi 4 has USB 3.0 ports, you could attach a SDD using an adapter.
They could add support for MLV format in rapiraw using Ilia's lib, so we could process using MLVApp... just an idea :P

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #43 on: May 22, 2020, 10:49:17 AM »
In theory, the files 'rawvid' and 'rawtest' in the Dropbox link should be raw video, not processed or converted into anything... but I have no idea how to go about looking at them, or looking at whatever information they might hold.

( https://www.dropbox.com/sh/seddezwwymwnh4v/AAAU5es-RCWOXCj1Fpkbz3Dba?dl=0 )

With my limited knowledge, Raspiraw helps decode this and then another program (dcraw) wraps it in a ppm container. I understand the concept and everything in theory, but actually getting it to work in practice is beyond my comprehension. In the words of the developer:

'If you expect everything spoon-fed to you, then raspiraw is not the program for you.'

I love ML on my Canon cameras. Thanks to the efforts of the people behind it, it's easy to understand, set up and work with. Raspiraw seems to be very different from a user's perspective... maybe the backend of ML is similar, but it's hidden behind the UI - I have no idea.

Not wanting to sound selfish, but my camera setup is working as is, albeit with .264 outputs... My switches run the codes I need them to, and I very much hope that in the future I can record some sort of raw, be it DNG, or MLV.

I'd love to be able to help out here, but without being instructed to try specific things, I don't know what I can do. I'll continue to do my own testing and post results, so please feel free to recommend certain (and specific) things, but keep in mind I am not a programmer and beyond the basics, learning python is a pain in my ass.

With all of that said, I do have a VNC on my pi and it's setup to work with remote connections, so I'm happy to connect with people and let them control my system and test scripts and stuff to give someone with more knowledge a chance to make some progress...

Anaconda_

  • New to the forum
  • *
  • Posts: 20
Re: Raspberry Pi High Quality Camera
« Reply #44 on: Yesterday at 05:08:46 PM »
I've added a .rgb file, which should be fairly raw. I've read you can decode it with dcraw, I have dcraw installed, and am just working out how to use it.

I'm not having any luck and need to stop working on this project for now.. Anyone else can feel free to try and get things working :)

Let me know how you get on!