MAVProxy AI Chat Enhancements
- Mentors
- Randy Mackay, MichelleR
- Organization
- ArduPilot
- Technologies
- python, ai, OpenAI, GPT, LLMs
- Topics
- robotics, ai, GPTs, OpenAI assistant api
MAVProxy is a powerful command-line based “developer” ground station software. It can be extended via add-on modules, this project is about Chat module, which enables user to query or control the vehicle by giving audio or chat prompts.
The proposal is to enhance AI chat module by
1. Adding chat streaming support, which enables users to see response as soon as it starts generating which makes the wait time less annoying and also saves user's time as user can start reading the chats as soon as they are generated,
2. Audio recording enhancements i.e. implementing a push button to record feature in which recording will start when button is pushed and will stop when button is released, currently it is hard coded to 3seconds i.e. it automatically stops recording after 5 seconds
3. adding cancel feature to cancel current run with chat-bot, currently if user prompts something then it will not cancel or stop before it completes the run.
4. Experimentation with local llms
5. Moreover will experiment with the assistant prompts for better results and reduced latency.