Office politics... Adding on to what
>>2 has said, how do you know the reason they're talking behind your back? Do your colleagues constantly talk bad about you? A good way to start conversations with them is to ask them about work related stuff. You mentioned that you're not too proficient at what you do, you could seek help from them when needed.
Ultimately there must be some kind of strong distaste for you to be continually be the talk of the town. Try to close up any misunderstandings by talking to them.