Skip to content

Yannnyan/TelloAI_Drone

Repository files navigation

TelloAI_Drone

  • Drones - using the 100 gram 100$ Tello Drones.
  • Drones competition in uni where I won second place
  • Video of the Competition: Click me
    image

Overview

Project Details: Using CV for python library called CV2, create an algorithm for flying a drone in space in real time using image processing, and computer vision to detect aruco makers, estimate thier distances and angles from the drone, and then fly the drone using the markers as a guidance helper, to navigate through the room and through challenges set across it, such as flying inside a passage, and flying upwards the stairs, and rotating and mantaining balance in the room.
Using small edu drones, and thier SDK(Software Developement Kit) for giving them commands to follow such as, go forward turn clockwise, etc...
image


Ryze Tello Sdk

Challenges/Struggles

  • Using windows as operating system might slow real time communication with the drone, use linux instead, since the packet transfer is done with UDP, windows tends to hold on to the packets and result in packet loss to the drone. It's a problem because a packet contains a command for the drone to do, so if it goes to waste then the drone might be waiting for commands but not recieving any.
  • Creating a multithreaded algorithm for recieving images in real time and processing them on another thread, and sending commands to the drone on another thread.
  • Navigate the drone across the room using different markers, by calculating thier distances and angles from the drone, was a headache using CV arucodetect module, and using mathematical equations to calculate the distance using the optical focal length of the pinhole camera of the drone.
  • Not crushing the drone and resulting in failure of it's propelors and damaging it's stability measurements.
  • The drone battery was really not enough for running tests on the drone, it only lasts for about 15 minutes or less. So to solve this I used around 4 batteries I borrowed from friends and usb-c chargers meanwhile coding and running tests.

Images And Extra Visualization

The Competition's Route

image image

Drone Size Comparison

image

Group Picture

image

Extra Project Documentations and summary

Link for event summary and description : https://docs.google.com/document/d/1xSagBC9Kp3lFaz0BnJAtK0Gy1gmYUMocNU_cYfQpZbs/edit
link for the git that is extension to the description : https://github.com/AlonBarak-dev/Tello-Semi-Autonomous

About

Drones competition in university, Computer Vision, Real Time, SDK

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages