Yes, there is a possibility of it, but the difference can barely be noticed. 

And if your ISP is using a certain kind of traffic, using a VPN could actually boost Your connection!