I have to dispute that. I levelled from 16-17 doing almost nothing but killing Empyrean Watchers. NO faction hit whatsoever, and believe me, I was watching it like a hawk.
Besides, faction affected creatures will always go hostile to you BEFORE they go aggressive, except for Land Sheeries, which go aggro. after you kill just one.