Look at this kit on Amazon:-
https://www.amazon.co.uk/Compatible-Davidson-Motorcycles-Installer-Bearings/dp/B08FD24KJ1?th=1
Select the second picture and hover over to enlarge. You should see part 6 which is the bearing installer. Can you see that raised lip around the edge? That is bad if the bearing is fully seated until the inner race contacts the spacer. You need to modify the installation to turn that part round before finally seating the bearing or remove that lip.
The other thing worth doing is replacing the brass washer with a thrust bearing or NICE bearing as it is called in some versions.
You have this kit available to members and it has the bearing and not the washer.