Wals Roberta Sets 1-36.zip -

Run statistical probes on the pre-trained RoBERTa attention heads. If certain heads consistently attend to features like "Order of Subject, Object, and Verb," you have evidence that the model internalizes Greenbergian universals.

RoBERTa is an advanced iteration of Google's BERT model developed by Meta AI. WALS Roberta Sets 1-36.zip