Cotton velvet fabric feels softer and skin friendly than polyester velvet. And cotton is more sustainable and breathable than polyester. But polyester velvet looks more glossy than cotton velvet. This is the same for velour or velveteen fabric.
Moreover, cotton velvet costs higher than polyester velvet.