theAIcatchup

Abstract map of vector space with clustered word embeddings like cat and kitten nearby

Embedding Maps: Semantic Smoke and Vectors

Embedding models claim to 'understand' language via invisible maps. Spoiler: They don't. Just fancy math cosplaying as cognition.

3 min read 1 day, 23 hours ago

Diagram dissecting BERT input embeddings versus standard Transformer encoder

AI Hardware

BERT's Bidirectionality: Transformer Hype or Training Trick?

BERT exploded onto NLP in 2018, leaping GLUE scores by 7.7 points. But its 'bidirectional' brag? Mostly a clever training hack on old Transformer bones.

3 min read 1 week, 6 days ago

#BERT

Embedding Maps: Semantic Smoke and Vectors

BERT's Bidirectionality: Transformer Hype or Training Trick?

Stay in the loop