You must be knowing that you can not delete unused or incorrect tracking entries for case entity as per the standard feature ptovided.
Here is the component that we have developed if you want this kind of functionality in CRM.
After installing this component you will see the new tab called Case Tracking under the cases entity. After clicking on this tab, you can see the list which shows all the tracking records for the current case in context from case progress.(Please refer the below screenshot.)
After clicking on the Status Image or hyperlink of the Created Date field value, a summary screen will be dispalyed as follows where there will be two buttons available Continue and Delete.
You can perform standard delete functionality by clicking on Delete button and this way you can delete the records one by one.