You are browsing as a guest. Sign up (or log in) to start making projects!

phattar4phan

@phattar4phan

Joined June 11th, 2026

  • 29Devlogs
  • 5Projects
  • 5Ships
  • 60Votes
Pretty much machine learning works
Open comments for this post
Reposted by @phattar4phan

10h 13m 57s logged

devlog#4, also again long time no see, been really busy with bunch of school works, but still also a bit of development almost everyday so here i modify the refseqs requests only 25 organisms and 6 genomes for each organism, also modified bunch of files to support the new refseqs.json style, and also trained the classifier model many mistakes and 100minutes * 10 epoch = 1000 minutes totaling, take so long to finish (around 16.67 hours *no more 67 atp) the model itself has 4 conv1d blocks and 2 layers of transformer, and the dataset itself has ~523M tokens (as of i remember) and the output is astonishing, as you can see in the image below, 0.062 loss, 98.11% accuracy, and validation loss of 0.7708, and validation accuracy of 88.84% (although it has 9% gap between acc and vacc but still nevermind this aint production grade and should not be use in production or other associated) also i test it with test data (from the dataloader split) and other dataset with the same organism but different genomes, i got avg loss at ~1.25 and avg test accuracy at ~82% pretty gooddd, that’s all for now, next is like genomic analysis, like promoter region prediction and open reading frame prediction (ORF) (for finding a sequence that potentially encodes a protein) and done genomes-level prediction and out off 306 genomes, got 292 correct which is 95.42% holy really welllllllllll!!!

2
1
151
Open comments for this post

10h 13m 57s logged

devlog#4, also again long time no see, been really busy with bunch of school works, but still also a bit of development almost everyday so here i modify the refseqs requests only 25 organisms and 6 genomes for each organism, also modified bunch of files to support the new refseqs.json style, and also trained the classifier model many mistakes and 100minutes * 10 epoch = 1000 minutes totaling, take so long to finish (around 16.67 hours *no more 67 atp) the model itself has 4 conv1d blocks and 2 layers of transformer, and the dataset itself has ~523M tokens (as of i remember) and the output is astonishing, as you can see in the image below, 0.062 loss, 98.11% accuracy, and validation loss of 0.7708, and validation accuracy of 88.84% (although it has 9% gap between acc and vacc but still nevermind this aint production grade and should not be use in production or other associated) also i test it with test data (from the dataloader split) and other dataset with the same organism but different genomes, i got avg loss at ~1.25 and avg test accuracy at ~82% pretty gooddd, that’s all for now, next is like genomic analysis, like promoter region prediction and open reading frame prediction (ORF) (for finding a sequence that potentially encodes a protein) and done genomes-level prediction and out off 306 genomes, got 292 correct which is 95.42% holy really welllllllllll!!!

2
1
151
Open comments for this post
Reposted by @phattar4phan

41m 25s logged

devlog#3, long time no see, been really busy with school works and practices for the incoming sport events and competitions. as of now i have created tokenizes.py first time i scale for 6-mers but then ;ater on i design to abuse my entire laptop and increase it to 8 and now my tokens.bin or basically binary of those token IDs has taken up 16.45GB of my disk space and it’s really huge, this gonna take so long to just train the CNN but nevermind, follow along!

0
1
6
Open comments for this post

41m 25s logged

devlog#3, long time no see, been really busy with school works and practices for the incoming sport events and competitions. as of now i have created tokenizes.py first time i scale for 6-mers but then ;ater on i design to abuse my entire laptop and increase it to 8 and now my tokens.bin or basically binary of those token IDs has taken up 16.45GB of my disk space and it’s really huge, this gonna take so long to just train the CNN but nevermind, follow along!

0
1
6
Open comments for this post

35m 52s logged

devlog#2 last time i forgot to add and commit the changes, so here it is and also create utils/split.py for splitting train, test and val with 80/10/10 ratio for the next development, i will do splitting each genomes into chunks at around 64 kb per chunk and might scale bigger if my vram wont hit oom error, and if i pass i will need to convert 6-mers into int, like mapping tokenization (ATGCGC -> 12 and more)

0
0
7
Open comments for this post

3h 35m 16s logged

devlog#1, initialized the project and done some brief project configurations, this took just minutes and then continue progressing on downloading the dataset from official NCBI rest api (documented here) after that is merging the .fna files (total of .fna might mot match total fasta files as of esch FASTA record might contains many .fna) and for the next development is k-mers tokenization which I will do it using overlapping (stride=1) 6-mers tokenization and use CNN + Transformer (and attention) for the best result and learning opportunity, follow along I guesd this might be my masterpiece

0
0
8
Ship

I made an SLM from scratch with 50M parameters and it took holy 18 hours just to train it and ended up with only 40.63% accuracy in training. If you try it at the site and it responded immediately please don’t decide that it didnt work, it’s just that it might failed to connect to the url model is deployed. If i takes long to respond, yeah it worked and dont ever trust this model first it’s not LLM second this is for experimental purposes.

  • 4 devlogs
  • 23h
  • 10.68x multiplier
  • 234 Stardust
Try project → See source code →
Open comments for this post

4h 49m 56s logged

final: redesign the webpage for easier reach and interaction, also readjust the training pipeline as the old one have many flaws that the I myself couldnt get respond when testing, and it’s fixed ig

0
0
3
Open comments for this post

34m 44s logged

Redesign the UX/UI to minimalist brutalism, as the previous version looks a lot vibecoded, so then i changed it to brutalism as it’s easy to create and rework

0
0
36
Ship

Dashtop - an app to send your local hardwares utilizations data to be accessible remotely via a URL, run installation by following the guidance at README at the github repository, this project is done because when training the AI i dont want to switch terminal just to see the utilizations and temps, so in order to eliminate that problem entirely i just create an app to solve this and it’s working really quite good, the pipeline is just extract, put them together and then send via FastAPI() to tunnel cloudflare URL (this is randomize, so it should also works on your machine if you installed it correctly), and thats it go to the URL while strip the /dashboard first if it loads then edit the url to have /dashboard at the end and you will see it, keep the daemon running to see continuously and use the same url, if it restarted run ~/.dashtop/url.sh or cat ~/.dashtop/tunnel_url to see URL

  • 2 devlogs
  • 7h
  • 7.15x multiplier
  • 49 Stardust
Try project → See source code →
Open comments for this post

5h 32m 58s logged

#2 - Final: Added dashboard to view remotely, telemetry data extractor and sender (src/pull.py) and more like install.sh (you can view the installation guidance at README.md in the repo) and url.sh to get URL and more

0
0
25
Open comments for this post

1h 16m logged

#1 - Initial project and some configurations, also add first-version utilizations extractor, such as extracting ram data, networking, disk i/o and cpu also reads available sensors temperatures

0
0
66
Open comments for this post

4h 19m 29s logged

Change the dataset from entirely scratch to Dolci-Instruct-SFT, then also add serializer (src/utils/serialize.py) to serialize the dataset into .txt file and then to train it with spm.SentencepieceTrain() (src/utils/tspm.py) also add bin.py to turn tokenized into token IDs for faster dataloder, also removed unnecessary file

0
0
3
Open comments for this post

43m 17s logged

Retrained the model as I have added ‘label_smoothing=0.1’ to criterion to lower the probability of image that is jot white blood cell to be classified and show as a type of wbc with high confident score, also removed static glassmorphism header from the site and also added grid table with some clustered gradients as the background to not make it static

0
0
7
Ship

I make an AI model that could classify white blood cell from scratch (one input at a time as I dont have enough compute unit), the challenging parts ware that I’m not really that good at math so yeah need some AI to help coding the model part to ensure as much accuracy as possible, although it’s minimal but I tried to make it have the highest possible accuracy, the last trained one got ‘Peak’ at 99.19% quite good but it results in getting 100% confident score every time. Before testing, you can test it directly in the web, no downloading or installation required unless you want to make it locally (test at orion.phattar4phan.workers.dev), Proud to show that at least I can make an AI model, next one will be small language model with only ~7.8m parameters, just wait!

  • 4 devlogs
  • 9h
  • 9.95x multiplier
  • 92 Stardust
Try project → See source code →
Open comments for this post

1h 45m 6s logged

Finale version, removed the 5 models comparison as I dont have time to create all that right now. Only 1 model 1 interference and it’s donee

0
0
6
Open comments for this post

10h 44m 9s logged

#1 - Been on configurating the project, also after configuration I go on getting the dataset, while you can search for them online, I wanna be really type of ‘from scratch’ so in this case I also create the dataset from scratch as well. And all those 10hrs 44m, I’ve been manually entering random wikipedia articles to the code to scrap the texts, The main obstacle that make this so long is that sometimes I have typos, wrong words, or even not found which I’ve to also manually resolve all of them. Thats all but been going on around ~1600 articles

0
0
2
Ship

Created my website, I use AI for designing and some coding as am not really experienced wiyh .tsx and designing. This portfolio includes about section, skills section, projects, experiences and contact. the tech stack for this site are Vite, Tailwindcss, React, Lucide-react, and TypeScript. Also I’m proud that I can finally have a stunning portfolio website after stardance encouraging missions (this project was part of the mission Personal Site)

  • 1 devlog
  • 0h
  • 5.37x multiplier
  • 2 Stardust
Try project → See source code →
Loading more…

Followers

Loading…