IRX-2, Cyclophosphamide, and Nivolumab in Treating Patients With Recurrent or Metastatic and Refractory Liver Cancer

Inclusion Criteria: * Patients with histologically or cytologically confirmed recurrent or metastatic hepatocellular carcinoma (HCC). * Patients must have recurrent or metastatic HCC that are not amenable to local therapy with curative intent (surgery or radiation therapy with or without chemotherapy). * Must have failed or not tolerated at least one line of treatment for advanced HCC. * Willing and able to give informed consent and adhere to protocol therapy; written informed consent and any locally required authorization must be obtained from the patient prior to performing any protocol?related procedures, including screening evaluations. * Up to three prior systemic therapy regimens for recurrent and/or metastatic disease. * Eastern Cooperative Oncology Group (ECOG) 0?1. * Have a Child?Pugh class A liver score within 7 days of first dose of study drug. * Hemoglobin \> 8 g/dL. * Absolute neutrophil count (ANC) \> 1,200 x 10\^9/mL. * Platelet count \> 60 x 10\^9/mL. * Serum bilirubin =\< 1.5 x institutional upper limit of normal (ULN). * Aspartate aminotransferase (AST/serum glutamic oxaloacetic transaminase \[SGOT\]) and alanine aminotransferase (ALT/serum glutamate pyruvate transaminase \[SGPT\]) =\< 5 x ULN. * Serum albumin \> 3.0 g/dL. * Prothrombin time (PT) and partial thromboplastin time (PTT) \< 1.5 x the ULN. * Measured creatinine clearance (CL) \> 40 mL/min or calculated creatinine clearance CL \> 40 mL/min by the Cockcroft?Gault formula 10 or by 24?hour urine col…