This next action is infrequently adopted but it is worthwhile, since it will save you a large number of trouble later on. Use some latex primer around the filler, as this may clearly show up any leftover imperfections. Go away to dry as encouraged and sand using a fine sandpaper https://paintingthepastuk.co.uk/products/wood-paint-yellow-no-1