Stereotactic Body Radiation Therapy, Tremelimumab and Durvalumab in Treating Participants With Recurrent or Metastatic Cervical, Vaginal, or Vulvar Cancers

Inclusion Criteria: * Written informed consent obtained from subject prior to any protocol related procedures * Performance status Eastern Cooperative Oncology Group (ECOG) 0-2. * Body weight \> 30 kg * Must have an average life expectancy of 6 months * Patient is able and willing to comply with protocol and study procedures for the duration of the study including undergoing treatment and scheduled visits and examinations including follow-up visits * Histological diagnosis of recurrent or metastatic cervical, vaginal, or vulvar cancer or an unknown pelvic malignancy most likely to have arisen from these sites as determined clinically by the treating physicians (i.e. squamous cell carcinoma or adenocarcinoma that is high risk \[HR\] human papillomavirus positive \[HPV\]+, but not limited to this example) * Metastatic disease in at least two distinct lesions (including the index lesion to be treated) with at least one site outside of the radiation field and evaluable by Response Evaluation Criteria in Solid Tumors (RECIST) criteria for evaluation of response * At least one index lesion to be treated measuring 1 cm amenable to hypofractionated radiation therapy * Staging computed tomography (CT) scans done prior to enrollment * Have had at least one line of prior platinum-based systemic chemotherapy once diagnosed with recurrence or metastatic disease if primary cervical cancer. If a patient has primary vulvar or vaginal cancer, there is not a requirement. * May have received 1…