According to a Variety report published on Wednesday, Union was let go from the program along with fellow judge, Julianne Hough, after they complained about a toxic work environment.