Yahoo Engineering

These are some of the top sites' engineering blogs which I collected over a period of time - I removed those which have already been posted:

Google: http://googledevelopers.blogspot.com/ http://google-engtools.blogspot.com/ http://googleresearch.blogspot.com/

YouTube: http://youtube-eng.blogspot.com/

Baidu: http://usa.baidu.com/category/baidutechblog/

Yahoo: http://yahooeng.tumblr.com/ http://yahoodevelopers.tumblr.com/

Wikipedia (closest I could find): https://blog.wikimedia.org/c/technology/

Amazon: https://aws.amazon.com/blogs/aws/

Twitter: https://engineering.twitter.com/

eBay: http://www.ebaytechblog.com/

Microsoft: http://microsoftengineering.com

FourSquare: http://engineering.foursquare.com/

Apple (closest): https://developer.apple.com/

Paypal: https://www.paypal-engineering.com/ https://devblog.paypal.com/

Dropbox: https://blogs.dropbox.com/tech/

Edit: More (collected from this link: http://www.quora.com/What-are-the-top-startup-engineering-blogs):

Yelp: http://engineeringblog.yelp.com/

Quora: http://engineering.quora.com/

Yammer: http://eng.yammer.com/blog/

AirBnB: http://nerds.airbnb.com/

Square: https://corner.squareup.com/

Flickr: http://code.flickr.net/

Soundcloud: https://developers.soundcloud.com/blog/

Cloudera: http://blog.cloudera.com/blog/

Slideshare: http://engineering.slideshare.net/

Heroku: http://engineering.heroku.com/

Pinterest: http://engineering.pinterest.com/

I'm mainly wary of Squarespace because their entire frontend compiles to YUI which stopped being maintained in August, 2014 (see https://yahooeng.tumblr.com/post/96098168666/important-announcement-regarding-yui). You don't write YUI, but that's what the code ends up as when you visit the site. I tried out their developer platform early after they launched it, and trying to be productive with it put my brain in a pretzel.

I feel as though the SS CMS is overpriced for the features you get, and you're locked into their tech stack & templating which I find leave something to be desired. You can use Wordpress as a CMS and use the API to get the data yourself, or just compile the site to static for free with a plugin, not to mention the large number of paid pluggable CMS solutions for developers. The list goes on, but a local development server shouldn't be this big of news for a CMS developer platform.

Thanks for raising this up. I spent way way more time on OPIC (almost a year) than robin hood hash map (2 weeks to complete the POC). Glad to see people noticing this project :)

The other comment pointed out MDBM, which I didn't know about.
From their performance number I think this may show that why OPIC robin hood is quite optimal.
https://yahooeng.tumblr.com/post/104861108931/mdbm-high-speed-database

MDMB gives users raw access to the mmaped data and pointers. And from its benchmarks it results 10x faster than rocksdb and leveldb. The design of OPIC has even less overhead (may not be a good thing) than MDBM, and it also works on a mmaped file (or anonymous swap). There's no lock, transaction, or WAL in OPIC. OPIC just brings you the raw performance a hash table can gives you.

React (outside of React Native) is being used on many high traffic websites.

- Facebook comments, chat, search, ads creation, photo upload, tablet website... and basically every new product being written.

- Entire Instagram website

- Yahoo Mail: http://yahooeng.tumblr.com/post/101682875656/evolving-yahoo-mail

- A lot of the Khan Academy front-end: http://khan.github.io/react-components/

- Netflix website and TV experiences: http://conf.reactjs.com/schedule.html#beyond-the-dom-how-netflix-plans-to-enhance-your-television-experience

- Many Airbnb new products: http://www.slideshare.net/spikebrehm/the-evolution-of-airbnbs-frontend

- Flipboard mobile website: http://engineering.flipboard.com/2015/02/mobile-web/

- ...

This post reminded me of a very old article from Yahoo/Tumblr explaining how they were (ab)using Ceph to generate thumbnails on the fly as pictures were uploaded using the Ceph OSD plugin interface.

Unfortunately the post seems to have disappeared from the internet (it was probably around 6 years ago), so here are some other teasers:

https://yahooeng.tumblr.com/post/116391291701/yahoo-cloud-object-store-object-storage-at

https://ceph.com/geen-categorie/dynamic-object-interfaces-with-lua/

Disclaimer: not affiliated with Ceph apart from being a happy sysadmin.