pull down to refresh
280 sats \ 4 replies \ @windward 24 Jan \ on: What’s your take on dedicated AI devices? tech
having a dedicated AI device, separate from the phone/laptop allows for a sort of physical opt in - the AI/LLM needs info from meatspace in order to pull information and do things - being able to literally put it away & turn off that info flow vs constantly pulling information off of my own phone/laptop personally feels better from a UX standpoint.
That’s an interesting take. I guess that’s not a problem for LLMs running locally though? And it seems like a lot of the open source models you run locally are already pretty good.
reply
How and why you should be using RSS in 2024
the principle remains the same - although the AI is not local on these ambient computers. you need to talk to it in some way, pin it on your clothes - if you can opt out of it by physically putting it away, makes it more controllable.
running AI locally
if it was running on the phone directly, I imagine there would be a few people suspicious it was "looking" at them or their things when they're not wanting it to.
Is the fear realistic? Probably not. But how many times a day does the average person accidentally fire up Alexa/Google Home/Siri? Probably more often than they'd admit - I would also imagine that firing up something significantly smarter that could book a plane for them just because they said so would be absolutely terrifying for some.
additionally the audience who is aware and capable of spinning up their own local LLM and the audience for something like the r1 or humane pin don't necessarily ovelap, even if it results in a more ideal, custom experience.
with that said, there's also a project to make an open source version of the r1 running an LLM locally: https://twitter.com/hellokillian/status/1745875973583896950
reply
The AI pin wouldn’t be nearly as useful without similar context and access to accounts as the phone has. At that point, it might as well be more of an input/output peripheral for a larger computing device, like a phone.