And, off course, just a few minutes later, I found the problem... Apparently (indeed) the apa.bst file contained an error.
The fix was easy: I just removed the bst file, LyX downloaded another one from the internet since it automaticly downloads missing packages in my case. And then it was fixed. (Even though I wasn't able to use the annotation style before without using the apa.bst file.)
