You should DEFINITELY see an orthopedic knee specialist. They are not just about cutting! IF, there is actually a small bone deformity causing your problem, nothing is going to make it better until you remove the deformation. IF, it is not the problem, they will be the best person to recommend insoles, physio, exercises, or whatever.
I had a "tiny" accident in the summer. Tripped, thought nothing of it. Turns out I tore the cartilage in my hip because I had a small bone "deformity" or it was a bit misshapen, it had never caused a problem until this little accident, and then everything just went downhill. In January (after four months of seeing an orthopedic team who recommended physio and conservative methods first above all) they did the surgery to re-shape the joint and allow the bones to fit together properly, and repair the cartilage damage. Without removing that peice of the bone, nothing would have let that heal.
A "rough" spot is not going to go away with painkillers and ice, we play through the pain too often I think. I was a bit sceptical such a little trip could have such a big consequence, but at three months post operation, oh baby was it the right decision. And, I never felt pressured or pushed, or that the surgen just wanted to cut, they really made me do months of physio to make sure it wouldn't get better on its own.