I've found a lot of problems with bitterness can be solved with time, don't sweat it. And boys, be nice to the new guy or he won't come back! <shakes accusing finger>
Unless you cracked the seeds (by putting them through a blender or something), it's not too likely to be the culprit for the bitterness, the orange rind (more specifically, the pith) is far more likely. The orange pith in a 1 month old JAO probably will be pretty gross. Let it settle out and age another month, it might be starting to integrate and mellow by then, and it'll probably be pretty good in 6 months.
I regularly break the warranty on JAO by using only the fruit and zest because including pith gives me heartburn. Still works, still tastes good. Just don't tell Joe I changed it...
"The main ingredient needed is 'time' followed closely by 'patience'." - The Bishop 2013
"When you consider that laziness and procrastination are the fundamentals of great mead, it is a miracle that the mazer cup happens." Medsen Fey, 2014
"Sure it can be done. I've never heard of it, but I do things I've never heard if all the time. That is the beauty of being a brewer!" - Loveofrose, 2014
"I tend to....um, er, experiment, and go outside the box. Sometimes outside the whole department store." - Ebonhawk, 2014