First, I want to say that I agree with Vivid Melody. Now for my viewpoint: Though I don't agree with polyamory, it's your life and it isn't killing anyone. Biologically, we're supposed to be monogamous, and some would actually argue promiscuous (look both terms up along with the word 'biological' or in biological aspects or you might get way too many definitions that don't relate to the scientific meaning). However, I can also say that my opinion on this topic is considerably biased due to the fact that our society was based on two people being in a relationship and working together to be in love and compromise and create a relationship that isn't toxic (well, today, the concept of a relationship has gone down the drain, but that's another story). Plus the fact that putting more people into a relationship isn't necessarily wise (just expressing my opinion...which is again biased, but by trust issues). I also think that you should really think about what you want to get into, and if you have doubts about your husband's opinion, then he's probably not completely okay with this decision. Again, I'm not hating on polyamory, but I wouldn't want that for myself because it's hard enough dealing with one guy and I want to find the one who I can truly connect with (well, if I ever find hope for love again, which isn't likely at this point). Plus, I'm not very trusting, and the more people, the more issues.
Whatever you decide, just remember that your husband's opinion counts too, I mean, you married him and vowed to stay with him through sickness and health and whatever else you say at a marriage ceremony (sorry, I don't know much about weddings--never was a fan). TO CLOSE THIS, I WILL SAY, ANYONE'S VIEWS ON POLYAMORY WON'T CHANGE MY VIEW ON THEM NEGATIVELY. IT'S JUST ANOTHER IDEA (FOR LACK OF A BETTER WORD...?) OF LOVE, AND THAT'S FINE. But some people might not like it and react terribly to it, so be careful who you tell. I hope I didn't offend. Have a good night.
Edit One: By the way, did he know you were polyamory? And I'm glad you take his own opinion seriously. :) Maybe you should work on your marriage for now? Don't know.. Good luck on your situation :)