adjusting cylinder bearings resulting in rail sweeper drag

I just adjusted my cylinder bearings with great care and find that now the rail sweepers, the cow-pusher things that are meant to keep the rails clean, are dragging.  Should I adjust these or just remove them?  Any advice?