You are browsing as a guest. Sign up (or log in) to start making projects!

Local-first Edge AI Assistant

By @dylanyfraser

  • 10 Devlogs
  • 32 Total hours

Privacy-first, on-device conversational assistant and research playground for local language models; implemented in Rust and exposed via a lightweight HTTP API.

Source
Ship #1

@dylanyfraser on Local-first Edge AI Assistant

I updated the README.md with instructions and began work on a plugin for natural language equation evaluation with a custom library I developed in rust. Soon you will be able to ask the agent questions such as “how long is a car typically”, and you can talk back and forth with it regarding conversions and transformations to the original equations. Once this integration is made as well, it should open the door for better tool calling using NLP to give the agent access to information such as location, proper browser use, and on-screen awareness potentially. At the moment the agents tool systems for accessing the date and time, as well as the native Apple calendar are the only ones complete, with this equation evaluator having a slight amount of polish to finish the implementation.

  • 10 devlogs
  • 32h
Try project → See source code →
Open comments for this post

@dylanyfraser on Local-first Edge AI Assistant

18h 28m 10s logged

I updated the README.md with refreshed information about the project and instructions on how to use/build it. I began work on an interactive REPL to test expression evaluation. My next steps are to give the agent access to this library I developed rather than a REPL for the user, and make it be able to use it with tool calls to evaluate math problems using natural language.

0
0
13

Delete project?

Are you sure you want to permanently delete this project? This action cannot be undone.

All devlogs, followers, and associated data will be removed.

Followers

Loading…