We loved Port Antonio - but we were able to still get our Negril fix in on the same trip. Check out GeeJam's website, they've got a nice list of attractions and restaurants in the area - many of which we hit on our trip.
I pretty hopeful that after nearly 4 years, I am finally on the positive side of your health journey. You are not alone!