a lego sorter app

Devlog #12
Project: LEGO Sorter
AppOverviewFinalizing the search system and completing the software development.Progress UpdateI fully finished the search and inventory system! It now supports detailed search filters and visual previews with images. With help from AI, I resolved a major issue where downloading images and syncing all storage bins was freezing the app due to long loading times. With an optimized asynchronous system in place, the entire software suite is complete. This marks the final devlog for the software phase.Next StepsShift focus entirely to the physical device and start building the hardware.Thank you for reading!

Devlog #11

Project: LEGO Sorter App

Overview

Connecting the software to the hardware.

Progress Update

Today, I built the interface that runs directly on the sorting machine. It successfully communicates with the esp32 via Python scripts. This marks a major milestone in bridging the simulation with the physical device.

Next Steps

Develop the “Pak een blokje” (Pick a brick) feature.

Finalize the inventory screen.

Thank you for reading!

Devlog #10

Project: LEGO Sorter App

Overview

Completion of the search and inventory system.

Progress Update

The search system is now complete, although I still need to polish minor details like text sizes and player preferences later. I downloaded a CSV file from BrickLink containing all existing LEGO bricks and built a search interface using toggles for specific categories like modified hinges. Users can input brick sizes to find specific parts, and the grid system updates accordingly.

Next Steps

Clean up the UI for the inventory tab.

Begin the next phase of development.

Thank you for reading!

Devlog #09

Project: LEGO Sorter App

Overview

Managing the UI for the two sides of the sorting machine.

Progress Update

I have built the system for both sides of the machine, including a screen-switching mechanism. Implementing the screen transitions was time-consuming due to the grid layout, but it is now functioning as intended. My next focus is researching how to connect the BrickLink database to Unity so that specific bricks can be assigned to individual cups.

Next Steps

Integrate the BrickLink database into the project.

Refine the assignment logic for bricks and cups.

Thank you for reading!

Devlog #08

Project: LEGO Sorter App

Overview

Development of the cup grid system.

Progress Update

I created a grid representing the LEGO storage cups, with 500 spots on each side. I implemented a system where these spots function as buttons, including a zoom functionality for better accessibility. I faced an issue where only the first layer would move correctly during interaction, but I was eventually able to resolve this with some help from AI.

Next Steps

Continue refining the grid interactions.

Begin integrating the sorting logic with the grid.

Thank you for reading!

Devlog #07

Project: LEGO Sorter App

Overview

The simulation tab is now complete.

Progress Update

I have finalized the UI for the simulation tab, which now includes sliders to adjust the rotation speed and the drop timing. I have also implemented a calculation system that determines the throughput of the machine, measured in bricks per hour.

Next Steps

Transition to developing a new tab for the application.

Thank you for reading!

Devlog #06

Project: LEGO Sorter App

Overview

Improvements to the detection accuracy of the system.

Progress Update

The system is now performing reliably. By introducing a timer that allows the brick to fall for a slightly longer duration before scanning, the AI is consistently identifying the bricks correctly.

Next Steps

Finalize the simulation tab interface.

Begin work on additional UI elements.

Thank you for reading!

Devlog #05

Project: LEGO Sorter App

Overview

I have successfully integrated the Brickognize API into the Unity environment.

Progress Update

Getting the colliders and rotation to sync with brick falling was difficult, but it is now operational. I implemented a logic where the brick becomes a child of the carousel upon contact. Furthermore, I set up a system that captures images of both the top and bottom of the brick and sends them to the Brickognize API. Because I had trouble getting the implementation to work, I utilized AI to assist with the Python script used for API communication within Unity.

Next Steps

Tweak the physical interaction of the bricks to make the movement feel more realistic.

Continue optimizing the detection workflow.

Thank you for reading!

Devlog #04

Project: LEGO Sorter App

Overview

This update focuses on optimizing the carousel simulation and implementing a collision avoidance system.

Progress Update

After troubleshooting various joint configurations that did not perform as expected, I pivoted to using transform-based simulation for the carousel. I also implemented a safety system: if a brick is detected in the fall range of another C-channel, that specific channel will pause its movement to prevent jams. This ensures that bricks are handled one at a time.

Next Steps

Implement image capturing of the carousel using OpenCV.

Integrate the Brickognize API to identify the LEGO bricks.

Thank you for reading!

Devlog #03

Project: LEGO Sorter App

Overview

The simulation is taking shape with the addition of physical interactions and movement.

Progress Update

I have implemented the script that allows the C-channel to rotate. I also set up the spawning logic for the LEGO bricks. A significant challenge was fine-tuning the mesh colliders and rigidbodies to ensure the bricks interact correctly. The bricks currently lack sufficient traction, so I will need to experiment with different mass settings and physical properties.

Next Steps

Test different physics configurations to optimize brick movement.

Refine the interaction between the bricks and the carousel.

Thank you for reading!

Devlog #02

Project: LEGO Sorter App

Overview

Today, I made progress on the Unity simulation environment.

Progress Update

I successfully imported the 3D model of the C-channel, which I designed in Fusion 360, into the Unity project. Additionally, I implemented a camera script that allows for viewing the model from different angles and includes a zoom function for closer inspection of the components.

Next Steps

Begin integrating rotation logic for the components.

Set up the brick spawning mechanics.

Thank you for reading!

Devlog #01

Project: LEGO Sorter App

Overview

Hello everyone, welcome to the first devlog for the LEGO Sorter App. I have officially started working on this project, which involves two main components: designing the physical sorter in Fusion 360 and developing the software application in Unity to manage the sorting process.

Progress Update

Today, I have nearly completed the physical model for the sorter in Fusion 360. Simultaneously, I have begun the foundational work in Unity by implementing the basic UI and buttons that allow for navigation between different scenes.

Next Steps

Continue refining the physical model in Fusion 360.

Expand the Unity interface to include more detailed menus.

Thank you for reading!