

20·
2 days agoAs funny as this is (and I do find it funny), it’s also concerning on a wider level. A good number of people trust these AI summaries; they shouldn’t, but they do. And if it’s this easy to poison the AIs, imagine how easy it is for someone with an actual agenda to mislead people in ways that aren’t as fantastical and quickly spotted.
I seem to recall reading recently that a court in Germany wanted to hold Google accountable for the content of its AI summaries. (Someone correct me if I’m wrong, please.) If companies are going to shove these models in people’s faces they should absolutely be responsible for the results. If your model can’t tell fact from fiction, stop publishing - and promoting - it as fact.
Thank you for finding the link! I’ve no doubt Google will fight for as long as they can, but hopefully the German courts will hold their ground.
I’m far from an expert, but I feel like this is one of the limiting factors of LLMs - they have no sense of broader context. Truth vs. lie, outdated info vs. something that’s old but still correct… I’m not sure there’s ever going to be an LLM (at least one built in the way they are now) that will be good at actually producing correct responses. Maybe one day we’ll find a new way of achieving that goal, but I suspect what we’re seeing now isn’t going to be it.