Click menu "Tools" - "Internet options".

Under "Browsing history" hit "Settings".

Select "Every time I visit the webpage" and confirm with "OK".

Afterwards hit "Delete..." button in the "Browsing history" section.

A window with several delete buttons appears. Hit the "Delete files" button and confirm your choice by hitting "Yes" in the messagebox to follow.

The new settings will become effective as soon as you restart your browser (Internet Explorer). Just to be on the safe side, you can also restart the whole computer since Internet Explorer is tightly integrated with the Windows operating system.