Well, if it is brand new, you have to give it some time to get used to you. What I do, is putt it in a room with pagkain and water and litter and such, and stay in the room with it. Let it get used to you. Don't worry, I know how you feel.
Give it time. She/He will grow to like you. I have had experience with new kittens, and it hid under everything and jumped onto tall things. You should give it places to hide, and soon it will grow to pag-ibig you. Never get frustrated, and remember: You are huge compared to it! Imagine what you would think. Good luck!