@Matrix

Like i still have 9 hours left to ship as i logged 9 hours more for satisfying the changes required , so i was going to ship again but like i dont want to ship the project again with no change so instead i changed the theme from plain to this theme , like i played with color wheel for a bit and decide to implement this theme . As i read the ratings a lot of you said my project was exceptional the only thing needed work was the theme as it was plain so i changed it .

Rewrited and completely changed the frontend by hand .

Added more cool feature to the dashbaord . Just saw an reel and got an idea , so i implemented it right away .

i wroted the index.html the frontend part myself this time . I learned html , css and js according the requirement .Like i think html is basically nested boxes it was not that complicated and the documentation was also simple i understood it . Css was also good but js takes time . I think it was pretty similar to the streamlit experience liek the logic was same but this time i was writing it in different langugae i just needed the documenatiton for that . Than i deployed it again . I wanted to make the dashbaord looks like exactly like previous one so i treid to keep the theme same as i liked it .

I just got to know that we cant use streamlit for dashboard . So i switched to vercel . I wrote the code and everything was fine but in deployment process everytime some problem comes i am working and solving it from past 8 hours continuoulsly . hope it get accepted now . Also one thing to clarify if you open the url intially it will show api offlinne its not an problem or error in code . if you click the run analysis button api will be online and will show you the output so its not the problem . Bye

I have successfully deployed the app on streamlit . Although i faced many problems but i have finally done it . I also added an killer readme check it out . Thats it bye .

Final Devlog – this is going to be my last devlog . I have finally compelted the project . I have pretrained the model and save it in models file and used added ‘pretrain’ mode and ‘inference’ mode for my funtions for different model . So basically i used the pretrain model for pretraining the models and save it in the models file and used inference mode in the app.py my dashboard where it take the outputs from the models folder directly so it doesnt need to train again . Only readme is left for my project than i will ship it . Bye

I have improved and completed the final dashboard for the project . I have added more things like line chart , analysis summary , limitations also improved many other things and polished it . Done same to v1/v2 section improved it more and added more things . I also worked on the thing and added css code for it , as plain white was not up to the mark so i choosed this color .Now deploying it is left . But there is one problem like as it will on free cloud service by streamlit , i think it cant run heavy models like lstm , so i think i am gonna pre train the models save the outputs and than deploy it .

My research with Nasa dataset has officialy ended today , i tried the things that i can possibly do till now and now the time is almost up and i need the remaining time to focus on different things . so my V3.2 of project the calibration layer has also ended , but i found out that the fixes threshold plus persistance is working better than the calibration layer as it produces more precision and recall compare to others , so i think i am gonna keep it . As the dataset is the official and real dataset from NASA so it was expected . By i learned a lot throught this journey , started with Probability and statistics concepts and ended up making an system with real NASA dataset and implementing lstm (RNN) , and other ml models .

so i mainly focused on two things from past week . I was adding the calibration layer , in which my system is gonna select the best combination of persistance(continuous anomalies) and threshold my itself . For that first i am generating its threshold combination on the validation dataset , where i myself has injected fake anomalies in it . Than i am gonna test those threshold on the testing dataset(currently in progress) . I also completed adding the linear regression and random forest model to the dahboard so the user can choose it and run the model to see the results for that i created 2 more funtions for linear regressiona and random forest and connected it .

I was studying the outputs produced by my system across various channels , and was plotting multiple graphs , comparing multiple parameters to understand it .And i found out what i need to do next to increase my model efficiency , i know i cant make it perfect because i am currently working on a real dataset by NASA , also i dont have enough time because of my exams . so my next plan is to add an intelligence layer . Like before i was hardcoding the the thresholds like 2std or 3std and the min_consecutive value logic . so i decided to let my system decide it what is best for it . like i am gonna first train my lstm model on validation set and than like compute threshold with the validation error and also the min_consecutive logic and find the best pair and than test it with the testing dataset . and in past hours i also tried to add the option for user to select the model himself to see the output and result , implemented the random forest one , linear regression is left i think i will do it after the lstm improvement .so stay tuned

Update – Like i made an basic dashboard for my system .Like i separated it in 2 parts , first my previous stimulator based on my maths concept where i myselft created the random anomlies by inputing the no of request and prob of failures and than used z_Score or poission distirbution accorfing to which conditon it satisdy to conclude the results . Thats was V1 of my project , than added bayes concept like where my system pretend it doesnt know the cause , and it finf the p(cause|evidence) which is finding the prob of cause given evidence , that was v2 . now for v3 i created an different system where i added the nasa dataset and than run the models . So i put both of those to show my actual progress , and like user can play with both ones . now i think i will polish it more and than focus on improving the accuracy of lstm .

I implemented lstm , but its not that accurate , it works great and precision results are awesome , some channel precision were even 100 , but recall is mostly
average i need to improve it like its 26 - 45 % . But heres the problem , my school exams are coming and i need to start prepare for that urgently and cherry on top i have this weekend where i can try to give more hours but next week schedule is gonna be tough but i will still try to code and debug and plan everything and solve the problem . so i have decided first to make a dashboard using streamlit in python . That will include V1+V2 and V3 section where user can choose input like channels from NASA dataset and see the results and found anomalies in the system .So i am working on that and postponding my schedule to improve lstm later , because if i try to improve lstm now i dont know how much time it can take and like time will left for making dashbaord so i need to do this first because we get voting on usability section also and i dont it to be cli .

Update – i completed my analysis with linear regression and random forest model . I calculated the perdect tuning by changing window size to 10 and found out the best threshold for anomalies , my formula for threshold was x * std + mean , and chosing 0.5 as x gave us the best result and it makes as i realize because prediction errors during anomaly range arent that much bigger compare to errors in normal range . so thats why lowering down the x helped us . Also i created confusion matrix and get result for random forest and linear regression model, catching around 42 percent anomaly though only 12-13 % catched were actually correct . Tested the setup on multiple channels , some channels work perfectly and give some good results but some not and with no cleat pattern i end my case with lienar regression model and random forest here and moved towards implementing LSTM . Currently implemeting it and testing it and trying to improve the results . LSTM update will come in next devlog .

Update , like i finshed anlayzing the sensors . I plotted multiple sensors on graph and like for point i can observe pattern in the graph for changes like high spike in anomaly zone , but for contextual there was no similarity or pattern . even for point the spikes are not similar for every sensors . Some magintude and std is more compare to other . So i conclude that we cant make an rule based system for this dataset . I have to move towards implementing ml . So i used linear regression model first to train on first 10 input and than predict the 11th ouput , as i am doing time series analysis because my dataset is continuous data , so i have kept my window size 10 . so i am currently analyzing how many errors lie in our anoamly zone . If linear regression model didnt perfectly work i will try differnet model like random forest and if they also didnt work i have to move towards lstm .

I added real Nasa dataset to my system . Its NASA Anomaly Detection Dataset SMAP MSL . Its vast dataset have different sensors sendsing the telemary and giving the values i have been studying the data from the past 4 hours like across different channels to observe pattern . i currently found that channels of point like p-1 , e-11 have different pattern compared to contextual . like i calculated the changes in their consecutive values , and check the values under anomaly range provided inside the dataset . point sensors have very large amount of change inside their anomaly range and contextual have long runs of zero inside their anomaly range . I am still studying the data to conclude more information and patterns .

After building Bayes, I added a 3x3 confusion matrix to check its accuracy , it tracks how many predictions were correct versus which causes got mixed up with each other. Then I ran the simulation 10,000 times and saved the accuracy from each run into a list, and the average accuracy came out to about 98% . Next step is adding the NASA dataset to make it an real stimulation system .

So after hours of work i successfully added Bayes logic , it was not an easy task because to find p(cause|evidence) i needed to find p(evidence|cause) and p(cause) and p(evidence) for each possible cause . And i was so confused because i used lots of loops to implement this , and after hours i finally did it . And now for every given evidence i have the most probable cause . The bayes is gonna be more useful in future when i will add real dataset from Nasa and ml concepts also .