Ideally this shouldn’t happen. Glycerin soap base attracts moisture from air and thats how it keeps skin moisturised. You can try buying the glycerin soap base from other vendors and check whether you get the same results or not.