DevLog_2
So I Finally Was Able to Complete the AI Backend Part of the Project and let me tell you - IT WAS A NIGHTMARE.
For the First 4 Hours I Tried to get a Local VLM to Work but Due to my Low end Pc it wouldnt Work so I just Gave up and Switched to Free Openrouter Models.

So Here is What I’ve Made :
I Made the Python File Which would Load in all the Screenshots from the Main Script.
These Screenshots are then sent to an API which Describes What the User is Doing by Using the Cursor Locations.
All these Observations are then Compiled by a Smarter Model To make a Comprehensive Guide.

Now I plan to Try to Make a Simplistic IN-Python UI and a Script to Do all the Tasks and Package it.