As any InfoPath developer well knows, a checkbox is not just one item. It is the checkbox itself and the separate text portion. So, if you want to delete the checkbox, it’s a two-step process. However, it becomes much easier if the checkbox is in an HTML table or some sort of section/division.

Put your cursor inside the section (like a table cell) and triple click. That will highlight both parts – the checkbox and the text. At that point, just hit the delete key and both parts get deleted at once.