Hi Nkosi,
Just out of curiosity which underline are we talking about? Do you mean the focus outline? If so, that’s there for usability reasons.
If you remove it, just make sure that you have some other way of indicating which field is (clearly) focused, as to not compromise your users’ experience.