You could use loft to make it work but just simple extrude and shape with fillet can do it.
It’s kinda similar to this process for an AC knob.