You all who said to put the rest of the strings on were right of course (I didn't realize it would make that much difference). Still, the A and E strings buzz pretty bady, even open
Well, it's definitely above at the first fret, when fretting the 3rd. I'm going to see if I can raise the action...