Should I go back?

I've had a small lump under my nipple for probably about 3 years. Got it checked they wernt concerned. Went back like a year later as it had got bigger, nipple started inverting but she actually told me she was less concerned (she hadn't made any expression of concern before then). I pushed because of the changes, got a ultrasound scan and mamogram and then fine needle biopsy. This was july 2021. The results said "no evidence of worrying change. Biopsy showed some element of resolving inflammation and small possibility of breast trauma."

Then said "scan showed prominent milk duct with possible papilloma in it"

She did request me to go back due to the discrepancy between biopsy and scan. But as yet again they were telling me it's fine so I thought what's the point, travelling 2hours her to look and say it's fine and that theres nothing they will do about it again.

I've pretty much tried to ignore the lump since. But especially over the last few weeks/months it's quite painful. It feels like the shape of the lump has changed, it doesnt feel solid round anymore.

Cancer or not I dont want to keep wasting my time going back if they aren't going to do anything. She told me they wont remove it because of a few reasons plus I'd possibley loose sensitivity and I didn't want that, but considering the pain now, it's not like I get much pleasure out of it anyway because it hurts.

Is it worth going back considering what they say it is?