You can easily clear cache on Microsoft Edge by adjusting its settings to improve the browser's overall performance.
YouTube could slow down sometimes without you knowing because of the website and app caches. If this is enough to bother you, then you might want to clear them on your phone or desktop right away.