When is the best time to do a castor oil pack? The best time to do castor oil packs is when you can relax. So incorporating them into your bedtime routine or even while meditating, are great ideas.