293: Local AI
Download MP3Today I discuss how I've developed my own advanced AI, moving away from relying on external platforms. I've managed to evolve the Podscan system from basic alerts to being capable of answering complex questions, all thanks to using llama.cpp and Mistral 7b on my own servers.
This approach has given me complete control over our technology and made our project more attractive to potential buyers. By leveraging open-source tools, I've minimized our dependency on other platforms and improved our competitive position.
And it's because of thousands of people working on this for free that I get to do this. The community support for llama.cpp on GitHub has been a testament to the collaborative effort behind this advancement. This episode celebrates the bold initiatives taken by these awesome developers and entrepreneurs in the AI space, and you'll learn how managing AI in-house can revolutionize a small but powerful software venture.
This episode is sponsored by Acquire.com
The blog post: https://thebootstrappedfounder.com/local-ai-for-software-founders/
This approach has given me complete control over our technology and made our project more attractive to potential buyers. By leveraging open-source tools, I've minimized our dependency on other platforms and improved our competitive position.
And it's because of thousands of people working on this for free that I get to do this. The community support for llama.cpp on GitHub has been a testament to the collaborative effort behind this advancement. This episode celebrates the bold initiatives taken by these awesome developers and entrepreneurs in the AI space, and you'll learn how managing AI in-house can revolutionize a small but powerful software venture.
This episode is sponsored by Acquire.com
The blog post: https://thebootstrappedfounder.com/local-ai-for-software-founders/
The podcast episode: https://tbf.fm/episodes/293-local-ai
Check out Podscan to get alerts when you're mentioned on podcasts: https://podscan.fm
Send me a voicemail on Podline: https://podline.fm/arvid
You'll find my weekly article on my blog: https://thebootstrappedfounder.com
Newsletter: https://thebootstrappedfounder.com/newsletter
My book Zero to Sold: https://zerotosold.com/
My book The Embedded Entrepreneur: https://embeddedentrepreneur.com/
My course Find Your Following: https://findyourfollowing.com
Here are a few tools I use. Using my affiliate links will support my work at no additional cost to you.
- Notion (which I use to organize, write, coordinate, and archive my podcast + newsletter): https://affiliate.notion.so/465mv1536drx
- Riverside.fm (that's what I recorded this episode with): https://riverside.fm/?via=arvid
- TweetHunter (for speedy scheduling and writing Tweets): http://tweethunter.io/?via=arvid
- HypeFury (for massive Twitter analytics and scheduling): https://hypefury.com/?via=arvid60
- AudioPen (for taking voice notes and getting amazing summaries): https://audiopen.ai/?aff=PXErZ
- Descript (for word-based video editing, subtitles, and clips): https://www.descript.com/?lmref=3cf39Q
- ConvertKit (for email lists, newsletters, even finding sponsors): https://convertkit.com?lmref=bN9CZw
Creators and Guests
Host
Arvid Kahl
Empowering founders with kindness. Building in Public. Sold my SaaS FeedbackPanda for life-changing $ in 2019, now sharing my journey & what I learned.
