PI Pico Flight Controller on QuadCopter with Video LiveStream to Phone/PC on same network (WiFi)

My idea was to build a drone that would be running some CNN network on the image from the camera. The first step is to get a drone up and running with RF Controller! Second step to attach a camera and video feed! Third step is to process video input with algorithms and get desired movement response. So I have been doing some research one of which is your videos and I have seen the basic parts of drones: 1) Brushless Motors x4 2) 4 ESC or a 4in1 ESC 3) PDB 4) FC 5) Reciver 6) Transmiter This is basic drone setup with no vision. Which is the picture shown below! (1st Picture) I was woundering regarding the FC (Flight Controller) as they are pricey how hard is it to get it up and running and functioning on your own? The Flight Controller consists of Pi Pico and Mpu6050, Qmc5883 Modules. These calculations can run I have seen a similiar project! Could I also use GPS and can the Pico handle its calculations? The Reciver and Transmiter can be bought although ill build one myself with Arduino. All other is bought as parts, machined parts not easy to make urself!

you are completely forgetting about any and all stabilisation.

gyro, compass, altimeter, etc .

you cannot operate quadcopter without atleast gyro.

As for controller, look up Naze32. They are cheap, reliable and have variety of firmwares & connectible accessories.

<@329366633359343646>

you can feed it from pi acting as wireless bridge, but i wouldnt, i would use some "proprietary" radio. DMX, or cheaper FrSky

pi is not realtime. If it gets stuck, you are screwed.

you need something without OS for critical systems and control surfaces (or in copter case basically rotor control) IS the most critical system.

you can even 3Dprint body

THE SECOND THING IS THE CAMERA FEED! Ways of where to run my CNN algorithms: A) Embedded - RPI 3 or 4(max 5fps~Slow). B) WAN - local wireless where its video feed is conected either to GPU ( home setup) or mobile chip via wireless sharing. BEST OPTION C) INTERNET - Everywhere present and can always connect to GPU! STRONGER ALGORITHMS! DOWNSIDE is the Latency of the network which would be really slow sometimes and dependent either on 4G or WiFi So I'll either stream the Pi Camera stream via the RPI 3/4/Zero. Zeros can be nowhere found and the next best option is the 3 if not for the perfomance of 4 if embeding and later adding of modules with GPUs will be added. But 3 and 4 is a bit heavy for drones etc, not that much but it costs performance. But that aside for now. Can i video stream maybe over the PICO to get a stable 30 fps? The resoultion must not be great but the higher the better. Or is the RPI Pico not suited for camera feed and is not strong enough? I thought of broadcasting the video either on a WLAN where it is a local network so there is minimum Latency ~5ms. The second option is to send live video over internet, but that would have a large latency probably of >100ms for the command to return from the CNN Convolution Matrix Multiplication Algorithm back to the device. So what is your suggestion for the video stream, and what device is capable of Video Streaming in how good of a quality?

But the problem i have is mostly with the video transfer.

and that will cost more, than naze32.

video transfer is usually done on 5GHz.

since most if not all RC controllers are 2.4GHz

ye, but naze has everything inside.

which have differently written scripts and thread properties

minus radio.

sure 🙂

naze is quite reliable

only issue it has is with built-in altimeter. If you want to rely on it, make sure to cover it with black, non-transparent, but porous material that is not touching said sensor.

it is prone to heat/light spikes and if you for example fly out of shadow to sunlit area, your copter may suffer altitude changes. Massive ones.

but if you prevent light & heat from sun to affect it, you're cool.

in combination with NMEA GPS receiver you can do sub-meter stabilisation.

what country are you in?

ah

then go nuts

no regulations there 😄

Hahahahaha

True

here you cannot fly FPV

you have to go VFR

as for radio...

go with FrSky.

namely Taranis +

best budget radio

I mean here you cant actually either cause the laws are from the 70s where non corporation aka people cant have flying cameras etc because the Helicopters were all state owned xd

But no one cares

you can even buy a set with receiver with telemetry.

Yeah yeah ik that all

but wanted to do a build on my own to learn cool stuff and figure it out

thats why I was asking

Personally the cheapest video LiveStream RPI is Zero and then the 3 and 4? RPI Pico cant stream?