Publication on Medium-style platform covering AI topics, including LLM inference, RAG, applied machine learning projects, and the AI industry.
Commenters mostly cite it in passing; one comment about document-to-Markdown conversion tools is loosely related, and HN links it for LLM how-tos.
Both angles are real but they play out differently.
On the deliberate side: Nightshade showed you can poison image models with a few hundred modified samples. Backdoor attacks on LLMs (sleeper agents, trojan triggers) are an active research area, and the attack surface is huge because most training pipelines just scrape the open web. So yes, someone generating garbage on purpose can cause targeted damage, especially if they understand how the data gets collected.
But the scarier part is that nobody needs to try. The accidental contamination is already happening. Models train on web data, produce outputs that end up on the web, next generation trains on that. Dohmatob et al. showed 0.1% synthetic contamination is enough to cause measurable degradation. Right now no major dataset (FineWeb, RedPajama, C4) filters for AI-generated content.
What makes this harder to think about: data quality and model performance don't always follow "garbage in, garbage out." I wrote about a related paradox where Qwen2.5-Math trained with deliberately wrong reward signals still improved…
The article below compares 5 tools for a slightly different but close enough use case (more complex pdf than just running text). It concludes:
"Surprisingly, ChatGPT-4o gave the best Markdown output overall. Asking a multimodal LLM to simply convert a document to Markdown might be the best option if slow processing speed and token cost are not a problem."
https://ai.gopubby.com/benchmarking-pdf-to-markdown-document-converters-fc65a2c73bf2