Barrymore said it didn't feel "inappropriate" to party with the actor, who is 38 years older than her.