This Viewpoint discusses the potential benefits and risks, such as privacy violations, discrimination, and exacerbation of health disparities, that may accompany the unfiltered upload of electronic health records to large language models.