Piotr Migdał, a physicist turned data scientist, writes about deep learning, word embeddings, data science careers, and interactive explanations.
HN links it for machine learning explainers and his gender-differences dating analysis, which a commenter describes as even-handed.
Hey all,
Excited to share this demo with the HN.
All of the portraits in this demo are computer-generated by a machine learning model called “StyleGAN”. While most of the recent excitement around StyleGAN centers around its amazing ability to generate infinite variation (e.g. thispersondoesnotexist.com <3), the emergent semantics encoded in the latent space are impressive as well.
For instance, faces in this space allow for some semantic vector math, reminiscent of word2vec’s “king - man + woman = queen” (https://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html).
We can find the latent representations of, say, smiling people. We can then average them and create a new semantic vector that, when added to pictures of non-smiling faces, makes them all smile.
Play with the sliders to see what I mean.
Some possible applications: Generation of assets for games, Customizing ad photography by region/demographics, Lifelike, custom avatars, Compression, Modeling longitudinal medical imagery, Zero-shot inpainting, super-resolution, etc.
Happy to answer any questions!
For some reason, your question immediately reminded me of this: http://p.migdal.pl/2015/12/14/sci-to-data-sci.html
My guess is that a postdoc would be seen by prospective employers as a clear declaration of intent to stay in academia. But if that is what you want, you should use those few (hopefully!) years to build up a research portfolio which will get you a permanent position. Starting from scratch on something which you have no previous experience with is not the way to do that. I doubt anybody sensible would be willing to let you try on their dime.
If you do not intend to stay in academia, it is time to start revising down the value you assign to certificates of whatever. You are more likely to be asked for an interesting GitHub repo. But if you insist, there is a plethora of things like
https://www.microsoft.com/en-us/learning/certification-overview.aspx
http://education.oracle.com/pls/web_prod-plq-dad/db_pages.getpage?page_id=39
https://training.linuxfoundation.org/certification
The post title reminds me of something that I researched a little a couple months back. Practically all embeddings are implemented as vectors, right? Definitionally, an embedding doesn't have to be a vector. But in practice there's not really any such thing as a non-vector embedding, is there?
One thing I learned recently is that, if your embedding model supports task types (clustering, STS, retrieval, etc.), then that can have a non-trivial impact on the generated embedding for a given text: https://technicalwriting.dev/ml/embeddings/tasks/index.html
Parquet and Polars sound very promising for reducing embeddings storage requirements. Still haven't tinkered with them: https://minimaxir.com/2025/02/embeddings-parquet/
And this post gave me a lot more awareness to be more careful about how exactly I'm comparing embeddings. OP's post seems to do a good job explaining common techniques, too. https://p.migdal.pl/blog/2025/01/dont-use-cosine-similarity/
> I wrote Dating for Nerds: Gender differences (http://p.migdal.pl/2017/09/30/dating-for-nerds-gender-differ...) and got no backlash (much to my surprise, though).
Skimming through it, it does seem pretty even-handed. Although I'd like to point out that you're writing a "guide for nerds" and consistently addressing the reader as if they were a man. Women can be nerds, too. It's fair to have a guide for male nerds, since the experience is bound to be quite different for men vs. women, but it'd make sense to actually point that out.
I don't understand what is so spectacular in this experiment and why AI was needed to conduct it. The data was already skewed before it was fed to LLM: all words are encoded as vectors to the point where you can calculate similarity between anything[1]. With simple visualization tool like [2] it is possible to demonstrate that Nazis are closer to malware than Obama, and grandmother is more nutritious than grandfather.
[1] https://p.migdal.pl/blog/2017/01/king-man-woman-queen-why
[2] https://lamyiowce.github.io/word2viz/
I recommend you go for data science rather than finance.
For one you'll have less to learn to catch up (ML = prob theory + modelling skills). Also "data science" is a much broader skill that is in demand in many industries, while to apply your modelling skills to finance requires that you join one of the dirty banks, dirty hedge funds, or other dirty system construct.
This is a good book to have on the shelf: https://www.cs.ubc.ca/~murphyk/MLbook/
also on topic http://p.migdal.pl/2015/12/14/sci-to-data-sci.html