Help me set up local AI for my 85 year old aunt who is blind.

Hello all you smarter people. I recently retired and have taken on a task that is going to stretch me a bit. TL;DR My aging aunt is going blind and wants to keep writing stories that she's been writing for over 70 years. I think local AI has the ability to make this possible but I'm looking for a little guidance on the steps and the order. FULL VERSION My aunt is 85 and lives with me now. She has written over 150 stories in her lifetime. They are mostly detective fiction and old west outlaw fiction. She also has macular degeneration that has taken most of her eyesight. She has given up on everything else she used to do, but she still writes and edits her own stories. Lately she has talked about quitting this too because it's just too hard to keep writing even with a giant screen and high-contrast tools. After some discussion she agreed to try an interactive AI tool of some kind. I picked up a new desktop with an RTX 5080 (16gbVRAM) and 32 GB RAM. I got Unsloth desktop installed this weekend and I grabbed Gemma4 as my first model. But now I think I may be woefully out of my depth. I've mostly only written prompts for existing online models before. I've never actually started from scratch like this and I'm not sure how much prep I need to do before I start interacting with the model. There are a ton of videos and articles about running AI locally, but it's not easy for me to figure out which ones I can trust or which steps apply to me. I would really appreciate a link to a guide for total newbs like me. The use cases seem pretty simple to me: Interact with my aunt solely through voice and audio. Always be listening and available to her. Read her own stories to her in a natural voice that she gets to choose. Answer questions about existing stories to help her maintain continuity and bring old characters back from time to time. (She does this with handwritten notes right now and she's really struggling.) When prompted, suggest technical edits (spelling, grammar, etc) and help her stay consistent with those edits across all her stories. When prompted, suggest stylistic edits (clarity, pacing, etc) and help her stay consistent with those edits across all her stories. Prepare her stories for publication in KDP format (this one is mostly to help me do this for her). Here is the approach I was thinking I would follow, but after looking through all the Unsloth features I'm not sure how many steps I'm missing. Write instructions that I want the model to always follow. Place the instructions into the Unsloth System Prompt under Run Settings. Have my aunt converse with model via microphone. My instructions cover a LOT. - Brief description of my aunt and her writing goals and style. - Outline of her work (the types of stories and any connections). - Location of her existing stories. - Description of the AI's role and its primary tasks including definitions of terms. - A set of detailed rules to be followed when helping her edit. But I still have so many questions: - Do I need to create an unsloth project for this? - What's the best way to have the model listen to voice inputs from my aunt? - What's the best way to set up the model so it always listens for her input (kind of like an Alexa)? - How can I have it keep a log of all its work and make backups of files before it makes changes? (similar to how Google Docs keeps a revision history and allows you to go back and grab an older version of a file) Any insights folks want to share or resources you want to point me to would be most welcome. Thanks!

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论