Colorectal cancer starts in the colon or the rectum. These cancers can also be called colon cancer or rectal cancer, depending on where they start. Colon cancer and rectal cancer are often grouped together because they have many features in common. Cancer starts when cells in the body start to grow out of control.