I would go with what your partner says. I've a feeling that little Mowgli will be yours. If as you say, the neighbours are nice then they will come to realise (hopefully) that the cat has chosen you. What colour is she?
I think your problem is now solved and one thing is that if you love her then don't hesitate and make her your pet no matter what are the problem but just do it.