Author Topic: The future for ML  (Read 910 times)

garry23

  • Contributor
  • Hero Member
  • *****
  • Posts: 2208
The future for ML
« on: February 21, 2021, 07:29:16 PM »
Just me having a bit of weekend fun...in a positive way.

I’m so excited about the prospects of a resurgence in ML development, fingers crossed.

I see AI based ideas cropping up all over the place, eg this latest one from Leica 
You see these things unfolding in other cameras, and your mind opens regarding what ML could do in a modern Cam, eg an R series, with Lua scripting.

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7879
Re: The future for ML
« Reply #1 on: February 21, 2021, 08:03:20 PM »
Either I'm missing the point or I am missing the point.
Why is this something to write home about?

You still have perspective correction to take place and your image will be cropped accordingly and content will get lost in post. In worst case your composition (the idea behind the photo) will get destroyed. Nothing new so far.

names_are_hard

  • Developer
  • Senior
  • *****
  • Posts: 347
  • 200D idiot
Re: The future for ML
« Reply #2 on: February 21, 2021, 08:04:30 PM »
Garry was just spreading some optimism :)

garry23

  • Contributor
  • Hero Member
  • *****
  • Posts: 2208
Re: The future for ML
« Reply #3 on: February 21, 2021, 08:12:15 PM »
@names_are_hard

Thank you  ;)  :)

It’s becoming impossible to post on this forum because people only look literally at things.

Oh well, such is life when you have an international forum  :)  ;)

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7126
Re: The future for ML
« Reply #4 on: February 21, 2021, 08:58:40 PM »
I like this place and different viewpoints and personalities. That is, reactions and questions should be encouraged. Keep an open mind etc. A lot of personality doesn´t mean it´s always has to be personal ;).
Besides, I think we know each other quite well by now  8).

Luther

  • Senior
  • ****
  • Posts: 322
Re: The future for ML
« Reply #5 on: February 22, 2021, 03:55:24 PM »
A 11min video to explain a feature that could have been explained in 30 seconds...
But yeah, I get your point garry. I just don't see how ML can get better, it's kinda hardware-limited by now.
While we are at it, I've been testing frame interpolation using RIFE and I immediately thought about how this could benefit low-framerate/high-resolution MLVs. For example, recording at 12fps 4k and post-processing using RIFE to get 24fps.
Another idea: people are using canon cameras to build datasets to train machine learning. Magic Lantern could help to annotate this dataset, adding metadata that could be manually selected on-the-fly. For example: you could input 10 keywords. After each photograph is taken, ML asks what keyword to pick and automatically writes to the metadata that can then be parsed on the computer.
I have also been testing with video super-resolution, but there's not much future for amateurs because networks like EDVR/TecoGAN requires too much VRAM. Only ESRGAN is possible at the moment, but it has no temporal consistency so it's not really usable for video (although the results on photographs are amazing). There's also denoising, where DPIR works very well.
So, indeed, machine learning software can really help with the hardware limitations that (old) canon cameras have.

garry23

  • Contributor
  • Hero Member
  • *****
  • Posts: 2208
Re: The future for ML
« Reply #6 on: February 22, 2021, 05:17:46 PM »
Quote
I just don't see how ML can get better, it's kinda hardware-limited by now.

We all look at things through different eyes  ;D

The video was not the point of my post  ;)

I see untapped potential, ie building on the shoulders of giants.

Putting ML into new/modern Canon cameras: obviously.

Enhancing Lua scripting to give users what they individually want/need.

Bottom line: in the camera world, IMHO, ML is unique, and the star feature is scripting  :)


ChristianEOS

  • Freshman
  • **
  • Posts: 61
  • I love a meerkat Erdmännchen
Re: The future for ML
« Reply #7 on: February 23, 2021, 03:35:00 AM »
I hope I don't interrupt you. I just wanted to mention that the Blackmagic design idea also was a career changer. It isn't only the potential. Philip Bloom said, in his earlier YouTube videos. "I am sure Magic Lantern engineers are working on it this minute". Maybe all that work and success wasn't payed fairly. In the future of course it would be possible using Magic Lantern on the R5/R6. Having a proper strategy would maybe open the doors for other projects and it wouldn't seem like some stupid nerds wasting their time. The future can't be Rocket Lab (source: pcwelt.de) using a 5d3 for pictures of the earth by the way without Magic Lantern.
Christian Bruno James

jetrotal

  • New to the forum
  • *
  • Posts: 13
Re: The future for ML
« Reply #8 on: March 16, 2021, 11:40:02 AM »
In a science fiction world, magic lantern users would have easy access to crazy external hardware,
like this sd card with a "virtual gimbal" intergrated:
https://petapixel.com/2016/08/11/sd-card-built-gyro-sensor-stabilize-shots/

https://github.com/yossato/virtualGimbal

Maybe, we could even attach a smartphone over a camera and use its gyro sensor to stabilize footage