Let’s assume that you have added tons of icons to the Taskbar, which has created a mess. Now you want to remove them all and add new icons as per the requirements. In such situations ...
Then, drag and drop these into the Recycle Bin to remove them ... Further, if you've pinned File Explorer to the taskbar, you can right-click its icon to quickly access your pinned folders ...