Just like you, I have faced the same issue. I have over 1 year of experience but have recently started taking interviews on the phone majorly. While recruiting I do the pre-screening and I decide which candidates to call for interview. I basically judge on points like education, gaps between jobs, how long one person stays in one job and communication Skills. I take interviews of freshers. Here the technical team judges more ( I work in an IT Comp).
I just took one interview recently, and while i was forming a report, I got confused as to whether she would be good for the organization or not. I do feel that while taking face to face interview we can judge whether a candidate would be suitable for the job and company or not.
I know interview skills will become better with more experience but right now I just do not trust my judgment.
I am hoping we can become better soon in this.