A candidate is not fully-qualified but I don't want to reject him/her yet. Is it possible?

You may add a custom state (ex. Pooling state) so that the candidate is not notified of a rejection message if they're still under consideration. 

You can always send them a direct message if you have other concerns.