After months of torturing, i decided to reinstall from scratch my surface pro 4. Went to the site, downloaded surface Image, installed on USB and restored original image.
It worked fine until stupid windows update updated my drivers as well INTEL HD 520 and other drivers. I went back and rolled back all the drivers. Problem is gone for now.
Dont forget to disable automatic driver update in Group Policy