Colorectal cancer is a major public health issue due to its high incidence and mortality. It is, therefore, essential to identify histological markers for prognostic purposes and to optimize the therapeutic management of patients. The main objective of our study was to analyze the impact of new histoprognostic factors, such as tumor deposits, budding, poorly differentiated clusters, mode of infiltration, the intensity of inflammatory infiltrate and the type of tumor stroma, on the survival of patients with colon cancer. Two hundred and twenty-nine resected colon cancers were fully histologically reviewed, and survival and recurrence data were collected. Survival was analyzed using Kaplan-Meier curves. A univariate and multivariate Cox model was constructed to identify prognostic factors for overall survival and recurrence-free survival. The median overall survival of the patients was 60.2 months and the median recurrence-free survival was 46.9 months. Overall survival and recurrence-free survival were significantly worse in the presence of isolated tumor deposits (log rank = 0.003 and 0.001, respectively) and for an infiltrative type of tumor invasion (log rank = 0.008 and 0.02, respectively). High-grade budding was associated with a poor prognosis, with no significant difference. We did not find a significant prognostic impact of the presence of poorly differentiated clusters, the intensity of the inflammatory infiltrate or the stromal type. In conclusion, the analysis of these recent histoprognostic factors, such as tumor deposits, mode of infiltration, and budding, could be integrated into the results of pathological reports of colon cancers. Thus, the therapeutic management of patients could be adjusted by providing more aggressive treatments in the presence of some of these factors.