Https://docs.openvidu.io/en/2.15.0/deployment/deploying-on-premises/

https://docs.openvidu.io/en/2.15.0/deployment/deploying-on-premises/

Can we deploy it in our Windows Server which is a on premise server?

OpenVidu is only supported in Linux.