Be super careful if you are going to use a rasp on that excess. It looks like it could break easily if you put too much pressure on it. But it could just be the way it looks in the pic.
I would use a drum sander or angle grinder to take it down most of the way then a half-round file to blend it in.
I would use a drum sander or angle grinder to take it down most of the way then a half-round file to blend it in.