https://ofir.io/The-Use-Case-for-Relative-Position-Embeddings/
The Use Case for Relative Position Embeddings – Ofir Press
We’re in 2022 but many of our most popular causal language models (LMs), including GPT-3, still use absolute positional embeddings. I believe we should stop...
use caseofir pressrelativepositionembeddings
https://ofir.io/about/
Ofir Press
My thoughts on deep learning for NLP
ofir press
https://ofir.io/Self-ask-prompting/
Self-ask Prompting – Ofir Press
Self-ask is a new prompting method which improves the ability of language models to answer complex questions.
ofir pressselfaskprompting
https://ofir.io/How-to-Start-Learning-Deep-Learning/
How to Start Learning Deep Learning – Ofir Press
Due to the recent achievements of artificial neural networks across many different tasks (such as face recognition, object detection and Go), deep learning has...
how to startofir presslearningdeep
https://ofir.io/Tips-for-Junior-Researchers/
7 Tips for Junior Researchers – Ofir Press
Research: Research is hard and involves a tremendous amount of failure. It’s totally normal to feel like you didn’t progress in the past week, month, or year....
tips forofir pressjuniorresearchers