There's plenty of stuff that goes on in large organisations which sits in what I would call "minor illegality" i.e. technically illegal, but the sort of thing people are going to pretend not to notice as long as they can have plausible deniability themselves.
A 6x improvement from 50tps to 300tps for example would be pretty amazing. There’s apparently a threshold where virtually all problems can be brute forced by having a lot of fast tokens rather than a larger model.
The law firm that can never make it to court because they spend 80% of their time doing DevOps things like upgrading SW, patching vulns and exporting documents in the right format for discovery.
This is context for local LLMs like Siri so that when you say “Text James and tell him …” it knows which James you mean.
Likewise, you could say “Tell my boss I’m not coming in tomorrow” and it would have to know who your boss is.
We could get super angry about this, but seeing as it’s fully local and doesn’t leave the device, it really doesn’t seem like a big deal. Is it much different to your car remembering who you call and where you go at what times for navigation purposes?
It doesnt leave your device...until an authoritarian government extracts it without a warrant. Or a dozen other entities like divorce attorneys, business rivals, legal trolls, false accusers, nation states, teenage hackers, human traffickers.
How often is this endangering info available to anyone at my work or home when someone leaves their laptop open while going to the bathroom for 5 minutes?
It's irresponsible to collect and concentrate this much info on millions of people.
It's a no win situation. All of this surveillance is happening on the internet right now. All the companies are doing this surveillance Apple happens to be doing it on device. This is the data Apple is trying to prevent from leaving the device. Apple is constantly fighting court battles to protect the data. Apple is always being accused of hampering developers freedom's while trying to safeguard access to this data.
All that said turning off Apple Intelligence should eliminate the collection.
I hate to break it to you, but the Government doesn’t need your device’s data to get all that information about you if it has the necessary warrants. If you think you can win a battle against any government over the collection of evidence needed to prosecute you, as long as they do it lawfully, you are sorely mistaken.
This makes zero sense, and is delivered in a silly tone. The government can even get information about you when it doesn't have warrants (good luck fighting it after the fact), or got warrants from a secret court. The government cannot get information about you which has not been collected, because that is impossible.
If my threat model realistically included all of those things, then I would be very careful about keeping any sort of address book or contact log/history at all. At that point the only defense really is just to try to memorize phone numbers. And only talk when walking together, mob-style.
Ha, fair. To me its about the concentration of "high quality' or juicy data that makes a person vulnerable. When the stakes get higher, threat, reward, and the temptation for bad action increase.
Btw on android it's easy to make contacts self maintained. And to use an open source messenger so texts dont go through Google's servers. Not same level you're describing, but a huge defense against these "social graph intrusions."
Both of you will be carrying microphones, walking past people who are carrying microphones, and being video recorded from every building and from the networked doorstops of family homes.
If I were a mobster under government surveillance, why would I carry a mobile phone while discussing the family business, or intentionally allow anyone in my vicinity to do so, any more than I'd have such a conversation with someone I knew was wearing a wire?
... I feel like if an authoritarian government could extract the family classifier info from local, they could just extract the damn messages.
And if you think that handful of megabytes is too much, they could extract a million other signals that tell them this, such as who you have pinned in the relevant apps.
> seeing as it’s fully local and doesn’t leave the device
Running the tool on my Macbook (which I don't really use, but which is logged into my iCloud) shows tons of activity/names/contacts that's shared ("donated" in the system's terms) over from my iPhone, which I wouldn't have expected to synchronize to this laptop. The apps aren't installed on the laptop, I don't get notifications there or have any interaction with those people. I can even see some stats showing volume of activity on work apps installed on my phone inside a managed work profile, but it does seem to have filtered the actual contacts out.
Because its also used by other apps (e.g. Photos has a feature to identify faces and catalog people in your photo library, Messages has a feature to allow important messages through Do Not Disturb and infers importance from these stores).
Microsoft had this solved with Cortana 12 years ago. I would tell Cortana to text my boss, and if it didn’t know who my boss was, they would ask me who my boss was then it would store it for later boss calls.
The spying has no excuse and in the 2000s we would’ve called this malware and spyware, appropriately.
On top of dabinat's point on consent, there is the resource use and accuracy part.
I can't imagine how much sleuthing is needed to infer who would be someone's divorced mother if it wasn't explicitely labelled, but it's completely unneeded until the day they actually try to use that info through some Apple service. Then, they'll be in for a surprise the day it infers it's their boss instead.
What does it mean "fully local"? I have an old "kitchen Macbook" that I'm using pretty much exclusively for stuff like looking up cooking recepies. I don't have any photos there, any messaging apps, etc. But I'm logged in with my Apple account.
And guess what, that "local graph" sees everything I did on my iPhone - I see contacts from all messaging apps, including Signal. I see image-based people clusters, even though there are no local pictures to match faces against.
Ok so it’s significantly worse than Apple M6 and we don’t know if it’s cheaper or not
Edit: Ah sorry you’re right, the bandwidth is lower but the TOPS is a lot higher. I’m not sure how much effect you get from higher TOPS with such low bandwidth though.
> I’m not sure how much effect you get from higher TOPS with such low bandwidth though.
Raised arithmetic intensity. It would be quite good for LLM prefill, and decode would want to adapt by pushing parallelism higher (saving on memory bandwidth by reusing the same layer weights for multiple streams) or, if unable to do so (e.g. due to KV cache constraints) by resorting to speculative decoding (where the expensive 'validate' step handles tokens in parallel within a single stream). It does not make the platform inherently unviable. It would also do well at other tasks such as image/video generation, which is already quite compute bound.
In case of V2H it therefore doesn’t matter what supported EV you are using, rather what charger you are using.
In general for changeover during a black out, V2L is probably better, because with V2H the charger itself needs POWER to boot up and request V2G whereas V2L you can start from the EV itself.
Also, generally speaking V2H is designed to be grid-following and certified to half a dozen standards whereas V2L forms an isolated microgrid, and a lot of the rules are tossed out, which is what you want.
For V2L you just need a generator changeover to isolate your house from the grid (most commonly just a manual switch), and a reverse plug to connect EV output to switchboard input.
V2H can charge home battery systems, but V2L "cannot". There's obviously a market for "plug the 240V outlet on my EV into my house battery. Use the car to charge the house battery while the house is running off the house battery".
The integration between solar, battery, smart meter, charger and EV is a total mess right now and it’s suffering from a myriad of startups making just 1 more standard (currently: probably 400 standards).
An independent body or government needs to step in and make it law to fix it. Or; throw out the standards and make everything dumb as rocks, which as you mention might be easier, one plug is power in, one plug is power out.
I have a 2027 Bolt, and it has V2H but not V2L, and I just want V2L to charge my home battery system like you said. Haven't figured out a way yet. GM put encryption in that NACS port.
reply