The entire point of an academic paper is to add to the sum of human knowledge. How can an LLM trained on a subset of human knowledge possibly even begin to accurate evaluate such a paper?
I trust an LLM to review that the language used in the paper is grammatically correct, but not to evaluate new information for accuracy.
1) Humans also are trained on a subset of human knowledge.
2)A lot of papers are just about experimenting something, and then applying simple stats. Eg empirical studies, around 1/3rd of published papers. Like, we tried this drug or did this experiment, from a sample size X here are the results. An expert is needed to maybe comment on the conclusion/hypothesis of the underlying suspected mechanism, but LLMs are still very useful on catching bad statistics or p hacking (so so common)
One imagines that they're trying. I work at not-a-frontier-lab and my company still ended up hiring someone who apparently wasn't aware that we track system access. He was turned over to the federal authorities after trying to exfiltrate a lot of user+system data to North Korean IPs.
Polls use sampling to avoid the sort of social bias suggested by your question.
Ask the right person, like someone who protested, and they could tell you that literally everyone supports the protests. Why, everyone they know participated in at least one, and most of them went to many of them!
Regardless, I'm not sure why injustice should be subject to a popular referendum. If greater than 50% of polled North Koreans praise their current political leadership, does that make their current leadership good?
Hong Kong is one of my favorite cities, and I was there in 2019 as it happens, though not for the full year. I knew people who participated in protests, and people who sniffed and said they were stupid, although when pressed, that was more out of a belief (correct, it turns out) that they would be ineffective, and were dangerous to participate in.
It is still true that something of value has been lost, while it remains a fantastic city. It is still true that multiple political prisoners are being held on charges most of us would identify as unjust.
It is also true that protesters were upset about many varied things, including the outrageous cost of housing. But it's not clear what you're trying to say with that and silly arguing about polling sources. That Jimmy Lai, Joshua Wong, and many others deserve their imprisonment? That nothing of value has been lost as China has suppressed dissent and the free press in Hong Kong?
They absolutely deserved imprisonment. They broke laws and went to foreign countries for aid.
Imagine if Hawaii tried advocated for succession and went to China for help. The US isn't going to do anything? Come on. This double standard is ridiculous.
By the way, the protests lasted for an entire year before it ended. Clearly China gave them a lot of leeway. But in the end, if you tried to get foreign governments to interfere, you better have a good plan.
I'm really happy that we live in a world in which people who don't know how to use the tools they have (and can't be bothered to find out) can use a coding agent to make their own tool that does what they want the way they want it to!
I'm really sad that those people keep releasing those tools to other people via cookie-cutter websites filled with misinformation instead of just enjoying them privately.
> I'm really happy that we live in a world in which people who don't know how to use the tools
It's not a happy world. It's dystopian. I really don't like how unskilled people get confidence for creating novelty using AI and then dare to put themselves on a pedestal next to bona fide creators. It is robbing them of trust and authenticity.
My neighbor, who barely survived through high school, happily begged me to buy her book: "I created something very special to me. I'm asking my friends to support me by ordering my book. There is a lot of useful information inside based on years of research and observations, and months of putting everything together." I knew it would be complete and utter bullshit, yet I was curious. I ordered "the book". It is chock-full of misspelled words and the substance is just pure garbage. It's a waste of human potential, it's a waste of resources, but hey, now we have yet another fucking "author". Terrific.
> I'm really sad that those people keep releasing those tools to other people via cookie-cutter websites filled with misinformation instead of just enjoying them privately
Why would that make you really sad? If something scratches your itch, it might scratch someone else's, too. It's kind of like blogging for yourself when you solve an issue.
That's progressive disclosure, and it's usually considered to be a good thing for usability.
Let's be clear: if you save something in macOS, by default you get:
1. a text field with something like "Untitled" already selected, but not the extension, so if you just start typing, the extension isn't replaced.
2. a text field for tags to make organization easier
3. a Where drop-down with recent locations, favorites, drives, etc.
4. a button with an arrow pointing down next to the "where" list.
5. depending on the app, probably a format drop-down.
Friends and family who depend on "you're good with computers, right?" people like us, they get overwhelmed by too many choices. Here, macOS gives them five, only five, and the complaint is that most people ignore four of them!
Give them the larger menu by default, and it's more options to ignore. If someone is saving every single file to their Desktop (/me shudders), then they are ignoring every bit of even a small, simple UI, so giving them a more complicated UI accomplishes nothing good.
I said they're ignoring four of the five UI elements, but now I wonder how many of the files on the desktop are named "Untitled (38).pdf" or whatever. They could be ignoring all five!
Your list seems very preference-shaped, not pointing to actually-missing features I can see. You could make a case about discoverability, but it's hard to see how letter combinations that only work within one application and no others are easily memorized. If your habits mean you spend a lot of time working with files in a UI, then memorizing double-tap C and C+F might be easy for you. Otherwise, using the same Cmd+C and Opt+Cmd+C would have the benefit of doing what it does in nearly every other program. Or, as the other responder said, dragging auto-escapes appropriately.
I spend most of my time using a CLI, and I'm not claiming Finder is the best keyboard-driven file manager out there, but I will say that it's consistent, and works the way macOS works. Key combos work the way they work in every app, and holding down Opt updates the Edit menu to make it clear what would be different. You can do the most common things pretty easily and clearly, even if sometimes you have to use a mouse and right-click. There are also third-party apps for focused file management for pros, including some that use tuis, like ranger.
> Opt+Cmd+C would have the benefit of doing what it does in nearly every other program
So what do you think it does in Preview? In TextEdit? Are you not aware that you imaginary benefit doesn't exist even in the system default open file Finder window where you can't copy file path?
> Finder is fine: not the best, not the worst.
Very astute observation relevant to none of the things being discussed.
> Your list seems very preference-shaped, not pointing to actually-missing features I can see
Look closer! Besides that hard to say what you missed because you haven't said anything specific
For example, what is "preference-shaped" about this missing feature
> turn column view into a flat list of all files at or below the current dir for easier search
> it's hard to see how letter combinations that only work within one application and no others are easily memorized
It's very easy to see if you don't ignore use cases and add extra conditions. Like why does it universally have to be easy?? I mean, it doesn't even have to be easy for me, the extra convenience might be worth the effort of having to remember it
> might be easy for you. Otherwise
What do you mean "otherwise"? Why would you care about others to the detriment of your own ease?
> and holding down Opt updates the Edit menu
What does this have to do with anything? You can retain the visual updates of these menus even if you use sequence of keys! Press C and the copy command menu expands into a submenu of what you could copy next (path, extension, name). You'll retain your consistency at a higher ergonomic baseline for Finder, nothing stops the improvements here
> Or, as the other responder said, dragging auto-escapes appropriately.
And as I've replied there, it doesn't do that "appropriately"
> third-party apps for focused file management for pros
But that's exactly what I said!
> differentiate a real pro file manager from the toy of Finder
The word "most" is doing a lot here. Europe guarantees consumer rights by law, while the US relies on companies adopting the practices voluntarily. Most do, but larger companies more universally than smaller, and it's by no means universal.
We are talking of entrepreneurship and new companies, what small business are required to do for returns/refunds in the US is definitely not ahead of Europe for consumer protection.
It's not word choice, you are just making the wrong argument.
Let me support your argument by telling you what you just reminded me of...
I was briefly subscribed to the NYT from Germany. To my surprise, I couldn't cancel online, but had to call. (The EU has a law which requires that if you can subscribe online, you must be able to cancel online.)
They have national numbers for many countries, but they're just forwarders to the same call center, with notably mangled audio quality presumably due to multiple lossy compression algorithms applied at each hop of the call.
Additionally, there was lots of background noise when I got connected to a rep. Over this barely usable line, I was now asked to spell out my email address, which naturally took multiple attempts of painfully slow spelling before the rep was able to locate my account. (My very limited knowledge of the NATO alphabet didn't help.)
Of course, I then had to go through the spiel of declining alternative offers and providing a reason for my cancellation (all of which I never had to do in Germany before) before they finally confirmed it. Yeah, I'm glad about consumer protection law in the EU.
The same exists in the EU, French Le Monde (NYT local equivalent) required you for a long time to send a registered letter costing 7€ and a trip to the post office to cancel your subscription.
Don't buy if you don't like company policy, no need to have a law. There is plenty of choice in the US. Some companies even offer 90 days (again, no laws required).
I'd find it tiresome real quick to always have to research before purchasing anything if the vendor will treat me with respect. Having a baseline of what you can expect from any business relation guaranteed by law is pretty great, really.
Really? There are tons of ways to cheat and game any system, including consumer protection. No laws can close this completely. Darwin award is still a thing and will always be.
It may be only a matter of time before all devs remember to append ", and make no mistakes" to the end of their LLM prompts, but I don't think we as an industry will ever reach a point at which every release of every package/library/application is scanned with the most capable model available.
I mean, we've had tooling like fuzzers available for a very long time, and most devs haven't run one against their software ever, let alone before each release.
It's the human factor I think will keep this a problem essentially-forever.
I trust an LLM to review that the language used in the paper is grammatically correct, but not to evaluate new information for accuracy.