I heard from a friend that if you try to do it like that, and you accidentally hit a protruding edge with your bevel block file, you'll easily bend it over the binding, because it isn't anchored in the fingerboard at the ends. So wouldn't it be better to first file them of with a regular file first? I also see you have a very small board with tiny frets as an example / a reference. With Dunlop 6105, would your statement still apply?
When I've done it I looked for the fret which stuck out the most by rocking the file and then started filing gently until more of the frets came into contact with the file.
That's actually an ukulele fret board but it was the only photo I could find quickly.

