Towards Effective And Robust Transformer-Based Models For Biomedical Applications