I had some similar and obscure corruption issues that wound up being a symptom of failing ram in a main server node. After that, only issues have been conflicts. So I’d suggest checking hardware health in addition to the ideas about backups vs sync.

Some details. One of the major players doing the tar pit strategy is Cloudflare. They’re a giant in networking and infrastructure, and they use AI (more traditional, nit LLMs) ubiquitously to detect bots. So it is an arms race, but one where both sides have massive incentives.

Making nonsense is indeed detectable, but that misunderstands the purpose: economics. Scraping bots are used because they’re a cheap way to get training data. If you make a non zero portion of training data poisonous you’d have to spend increasingly many resources to filter it out. The better the nonsense, the harder to detect. Cloudflare is known it use small LLMs to generate the nonsense, hence requiring systems at least that complex to differentiate it.

So in short the tar pit with garbage data actually decreases the average value of scraped data for bots that ignore do not scrape instructions.

Was about to post a Hugging Face link til I finished reading. For what it’s worth, once you have Ollama installed it’s a single command to download, install, and immediately drop into a chat with a model, either from Ollama’s library or Hugging Face, or anyone else. On Arch the entire process to get it working with gpu acceleration was installing 2 packages then start ollama.

Orthokeratology lenses reshape your cornea overnight. Been using them for years, heartily recommend.

Have you tried recent models? They’re not perfect no, but they can usually get you most of the way there if not all the way. If you know how to structure the problem and prompt, granted.

I use Kagi, they provide access to all the main models in a chat interface and have a mode that feeds search engine results to them. It’s mostly replaced search engines for me. For programming work I find them very useful for using unfamiliar tools and libraries, I can ask it what I want to so and it’ll generally tell me how correctly. Importantly, the search engine mode has citations. $25 a month, but worth it.

The idea that “it’s ok cause we’d do the same” is ridiculous. There is no comparison: China is an authoritarian government and the parent company is practically an arm of the state. There are legitimate criticisms of American tech companies obviously, but they’re ultimately subject to the market and democratic governments. We shouldn’t be doing any business with authoritarians in the first place, much less inviting them to control a significant social media app in the guise of a legitimate business.