misskitty, I don't comment too much on here anymore due to time and whatnot, but I just had to come out of "lurk" mode for this.
Your new family member is adorable! And she IS lucky to have you (and you her). Don't let other people define who you are (the Dr. included - granted his medical opinion probably holds some weight but even doctors don't get everything right and some have pre-disposed biases that can sometimes hurt a patient more then help). I don't know who in your life is making you feel bad, but they are not you and at the end of the day it is your life to live how you wish. Unless someone is financially supporting you and has a stake in how you budget your expenses, then their opinion is just that. Nothing more or less and you don't have to listen to it if you don't want to.
I'm sure you're feeling so upset because obviously it is the opinion of someone close to you. But tell those naysayers to just "shut it!" :nono. Or, you can start hawking in on all the decisions they've made that you don't approve of. Usually that shuts people up pretty quick . .