You can use the batch import functionality in the Medplum App. You won't be able to import a CSV directly. Instead, you'll have to create a FHIR Transaction Bundle object in JSON - this helps preserve all the references. You can find more details over here:
https://www.hl7.org/fhir/http.html#transaction