Encorafenib, Binimetinib, and Nivolumab in Treating Microsatellite Stable BRAF V600E Metastatic Colorectal Cancer

Inclusion Criteria: * Participants must have histologically or cytologically confirmed diagnosis of adenocarcinoma of the colon or rectum, with clinical confirmation of unresectable and/or metastatic disease that is measurable according to Response Evaluation Criteria in Solid Tumors (RECIST 1.1) criteria * Confirmation of BRAFV600E tumor as detected from testing performed in a Clinical Laboratory Improvement Act (CLIA)-certified laboratory * Confirmation of MSS status from testing performed in a CLIA-certified laboratory * Prior treatment with at least one systemic chemotherapy regimen for mCRC, or recurrence/progression with development of unresectable or metastatic disease within 6 months of adjuvant chemotherapy for resected CRC * Eastern Cooperative Oncology Group performance status (ECOG PS) =\< 1 (Karnofsky \>= 70%) * Absolute neutrophil count (ANC) \>= 1.0 x 10\^9/L * Hemoglobin (Hgb) \>= 9 g/dL with or without transfusions * Platelets (PLT) \>= 100 x 10\^9/L without transfusions * Total bilirubin =\< 1.5 x upper limit of normal (ULN) and \< 2 mg/dL * Note: Patients who have a total bilirubin level \> 1.5 x ULN and/or have Gilbert's disease will be allowed if their direct bilirubin level is =\< 0.5 mg/dl or ULN, whichever is higher. * Aspartate aminotransferase (AST) and/or alanine aminotransferase (ALT) =\< 3 x ULN * Serum creatinine =\< 1.5 x ULN, or calculated creatinine clearance (determined as per Cockcroft-Gault) \>= 50 mL/min at screening * Corrected QT (QT…