ReversingLabs Blog

HiddenLayer's latest research uncovers a universal prompt injection bypass impacting GPT-4, Claude, Gemini, and more, exposing major LLM security gaps. (https://news.ycombinator.com/item?id=43793280)

1. Machine learning adversarial attacks are a ticking time bomb - TechTalks (https://bdtechtalks.com/2020/12/16/machine-learning-adversarial-attacks-against-machine-learning-time-bomb/)

2. How ChatGPT actually works (https://www.assemblyai.com/blog/how-chatgpt-actually-works/)

3. PrivacyRaven Has Left the Nest | Trail of Bits Blog (https://blog.trailofbits.com/2020/10/08/privacyraven-has-left-the-nest/)

4. Prompt injection: What's the worst that can happen? (https://simonwillison.net/2023/Apr/14/worst-that-can-happen/)

5. The big cybersecurity themes at Black Hat 2024 - and why they matter (https://www.reversinglabs.com/blog/the-big-cybersecurity-themes-at-black-hat-2024-and-why-they-matter)

It’s already extremely common in the Python, Ruby and Node ecosystem (see sources below).

The only company that has a real chance at making a dent in the issue is GitHub and to a degree they already have.

SOURCES:

- https://www.mandiant.com/resources/blog/supply-chain-node-js

- https://www.zdnet.com/article/backdoor-found-in-ruby-library-for-checking-for-strong-passwords/

- https://www.reversinglabs.com/blog/mining-for-malicious-ruby-gems

- https://news.sophos.com/en-us/2021/10/24/node-poisoning-hijacked-package-delivers-coin-miner-and-credential-stealing-backdoor/amp/

- https://www.bleepingcomputer.com/news/security/dev-corrupts-npm-libs-colors-and-faker-breaking-thousands-of-apps/amp/

- https://portswigger.net/daily-swig/amp/malicious-python-library-ctx-removed-from-pypi-repo

encrypts software code such that it’s only decrypted by the computer’s processor at the last possible moment before the code is executed.

I have heard this phrase repeated so many times in the advertisements for protectors/packers that it's become almost cliche. Such techniques have been around for over 20 years. Using the debug registers to store the decryption key is relatively well-known - and defeatable (this is 5+ years ago):

http://reversinglabs.com/newsroom/blog/lockpicking-telock.html

On the other hand, I like how the article presents the negative aspect too - that security features can be used to make systems secure against their owners is a point that I definitely believe needs to be more prominent among the public.

Because no other language has ever had supply chain attacks ever, in history. Nope.

https://blog.rust-lang.org/2022/05/10/malicious-crate-rustdecimal/

https://en.wikipedia.org/wiki/Log4Shell

https://blog.pypi.org/posts/2024-12-11-ultralytics-attack-analysis/

https://about.gitlab.com/blog/gitlab-catches-mongodb-go-module-supply-chain-attack/

https://www.reversinglabs.com/blog/packagist-php-repo-supply-chain-threat-what-you-need-to-know