Dump of a lot of things
Sup y’all! First devlog for this project.
I’m planning on making a website that will help with FRC scouting, where basically the website will take a FRC match video, and generate a choreo trajectory from it, from which people can use it for a bunch of statistical data, like determining exact cycle times, can be used by drivers to see how they can improve their skills, and for games where auto strategy is super important (like what happened in Norcal District Champs).
So far, I’ve worked on a wide variety of random things, of which I’ll explain from here:
-
Homography function: my plan is to determine the homography transform of the keypoints of the field, and transform it to the actual field, where you can map the pixels of the image to the field position, sooo yea.
-
experimentation with OpenCV tracking: experimented with cv tracking functions to focus on a robot, and find the center of the bounding box, from which it can be logged
-
making a robot bumper keypoint dataset: creating a dataset on roboflow in which it finds out the 4 keypoints of the robot bumpers, to try and extractas much accuracy, from which it can go through the homography function
challenges:
-
estimations of robot pose when its not on the screen
-
tracking through missed detections
-
inferring robot motions
-
temporal consistency (idk what that means mr. gpt)
for now I’ll be working on making the dataset for the robot keypoints, but i think this is a good start!