dreamwithpriyanshu

@dreamwithpriyanshu on Self Driving Car Simulation · 3 days ago

1h 25m 59s logged

Final Documentation and Enhancements
These are the one’s I did, took more than 3 hours but the work is finally finished.

Fixed Render WebSocket training and headless evaluation.

Migrated from DQN to transparent tabular SARSA.
Improved native human/agent playback, controls, traffic, and flicker.

Redesigned the frontend with calmer typography, colors, spacing, and CTAs.

The main task was to develop this graphs, it felt impossible but synching is also done !

Added comprehensive architecture, security, algorithm, command, UI, and timeline documentation.

Open comments for this post

@dreamwithpriyanshu on Self Driving Car Simulation · 3 days ago

1h 49m 24s logged

Deployment and Hosting Done
This was a basically a ai ml project still added a frontend for easier acces, if you install the project locally then each feature work perfectly, but for hosting web version just background service without demonstration work.

The first task was to reinvent the UI , figure out small issues like fresh github install will retrain the model from zero meaning all progress in vain. But now it resumes as the attributes are also posted and can be continued from saved checkpoint that are updated when we update the github code. On render it works on persistent history.

Apart from that worked on many issues and finally the project is completed.

Lot of hardwork switching from Streamlit to FASTAPI

Ship Pending review

@dreamwithpriyanshu on Self Driving Car Simulation · 3 days ago

I made a self driving car simulation, for learning SARS algo of reinforcement learning. The model is trained and stored locally and dashboard and stats in Streamlit. This is made from scratch. Challenge were ideating and picking one solution switched from DQN vs SARS to SARS only, the control GUI option werent working, the code was ambiguious alll that thing had to be resolved,

I learnt how to make project using Ai and human code mix, that is a great mix to look for, the architecture documentation and researching was a great win.

1 devlog
9h

Try project → See source code →

Open comments for this post

@dreamwithpriyanshu on Self Driving Car Simulation · 3 days ago

8h 40m 36s logged

Ideation & Initial Code Generation - What began just as school project, didnt thought to be too harsh, even using Ai to assist.
I had this idea to build Self driving car simulation, in which I researched and found we can use reinforcement algoritmns and chose Streamlit for Frotend, then finalised the plan

Tech Stack : - Python
I used Gymnassium - Highway env for Highway Environment, SAARS and DQN for learning and training model. The model is trained using State - Action - Reward system, with control of location thrust, speed lane and more.

There was no novelty just to write it, then I chose streamlit for the visualization of training but turned out to be my biggest mistake, started scaffolding the project, building helper function and script for training, start datbase and Q learning table.

Everything was good, then streamlit code for frontend the challenge I faced was, errors and not able to control environment and controls.

then shifted to native python shell, and optimized gui controls, code shortening, documentations for quick start, control and journals. These are the major parts I did. Almost had 40 + commits unlimited brain storming, decision making still model needs improvement, but I think its NERDEST.

What started as simple prompt journey taught several things, git merge conflicts to logical headache what to do now, at the end everything works fine button everything working and code is structured without AI slop.

If you are reading till now, leave a feedback for me to improve, I know its just a start but small steps count. Whoever is reading this, GOD BLESS YOU.