Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Importing patients from old platform #596

Closed
AmaniKrayemRCPCH opened this issue Oct 11, 2023 · 14 comments
Closed

Importing patients from old platform #596

AmaniKrayemRCPCH opened this issue Oct 11, 2023 · 14 comments
Assignees
@eatyourpeas @pacharanero @anchit-chandran

Comments

@AmaniKrayemRCPCH
Copy link
Contributor

AmaniKrayemRCPCH commented Oct 11, 2023 •
edited
Loading

Headers - Export_Final.csv
Data format - Key_Final.csv
50 dummy patients - DummyPatients_Final.csv

A couple notes:

  • Each patient is assigned to Trust. The referring hospital column is free-text and not mandatory.
  • I've also kept the ethnicity other free-text column, but it may not actually be of use here.
  • There are some Trust mergers that aren't reflected in our old platform. The details of mergers are here - Trust Mergers for Import.xlsx This is not comprehensive as we only note the mergers that we have been informed of.
@AmaniKrayemRCPCH
Copy link
Contributor Author

Another thing to note is that NHS numbers and postcodes aren't validated on the old platform. I've put valid data in the dummy patients CSV from online generators, but you will probably get errors when importing the actual data.

@anchit-chandran
Copy link
Collaborator

anchit-chandran commented Oct 20, 2023 •
edited
Loading

Hey @AmaniKrayemRCPCH , just to confirm - how does the S01DOBDateOnly col correspond to the defined S01DOB (datetime) header?

Image

@anchit-chandran
Copy link
Collaborator

Also wanted to confirm, went through the different available options from your data for ethnicities and mapped to what made most sense on how we define them.

Pls could you let me know if this is fine / any changes required? The format is:

netsolveEthnicity ~> ourEthnicity (description)

WBritish ~> A (British, Mixed British)
WIrish ~> C (Any other White background)
WOther ~> C (Any other White background)
BCaribbean ~> M (Caribbean)
BAfrican ~> N (African)
BOther ~> P (Any other Black background)
AIndian ~> H (Indian or British Indian)
APakistani ~> J (Pakistani or British Pakistani)
ABangladeshi ~> K (Bangladeshi or British Bangladeshi)
AOther ~> L (Any other Asian background)
MWBC ~> D (Mixed (White and Black Caribbean))
MWBA ~> E (Mixed (White and Black African))
MWAs ~> F (Mixed (White and Asian))
MOther ~> G (Any other mixed background)
OChinese ~> R (Chinese)
OOther ~> S (Any other ethnic group)
No ~> Z (Not Stated)
NK ~> Z (Not Stated)

@anchit-chandran
Copy link
Collaborator

anchit-chandran commented Oct 20, 2023 •
edited
Loading

Query 3 sorry:

we don't have any organisations for these 3 Trusts. Because each Case must be registered to an Organisation, I'm unsure what to do with these records.

Image

@AmaniKrayemRCPCH
Copy link
Contributor Author

AmaniKrayemRCPCH commented Oct 20, 2023 via email

@AmaniKrayemRCPCH
Copy link
Contributor Author

AmaniKrayemRCPCH commented Oct 20, 2023 via email

@AmaniKrayemRCPCH
Copy link
Contributor Author

In regards to the DOB column, that was an excel formatting issue.
Here's the fixed dataset -
DummyPatients_Final_20231020.csv

@ollyrice
Copy link

I'll be creating a SharePoint site "E12 data transfer" as a secure location to upload of exported NetSolving data.
Olly

@nikyraja
Copy link
Contributor

Thanks Olly for creating the SP site. The patient data has now been uploaded onto this site.

  • A note that the columns are in a slightly different order to the dummy patient version where DOB is now the final column. If this is an issue and we can redo.

This is ready for importing into the new platform - please let us know if you need anything!

@nikyraja
Copy link
Contributor

A note from Hannah on the download:

'For sitecode RH5 the sitename should be Somerset NHS Foundation Trust not Yeovil District Hospital NHS Foundation Trust.
Also, where it says NHS in the sitename and s01refferringhospital it will be written as Nhs rather than NHS.'

An updated version had been uploaded onto the site: 'Epilepsy12_Cohort6_APIexport_reformated_151123'

@pacharanero
Copy link
Member

WIP on this is in the #635 pull request.
Note that a previous Issue #552 suggesting the use of REST API for this has been superseded in favour of a simpler CSV importer.

@pacharanero pacharanero mentioned this issue Nov 15, 2023
Closed
6 tasks
@pacharanero
Copy link
Member

@AmaniKrayemRCPCH @nikyraja the initial import of patient data is now done on Staging, where you can log in to review and spot-check some cases, just to ensure we've got it all right. If Staging is OK then we do the same on Live and you are ready to go. (After which I'll delete data on Staging and revert to some dummy data)

@nikyraja
Copy link
Contributor

Thanks @pacharanero and all for this!

We have reviewed the data and performed random spot checks. I am satisfied that all the data that has been imported into the new platform is accurate against the data we supplied and the current NetSolving platform.

  • I am happy for you to move this to the live site and delete the data off staging.

A file has been uploaded to the SP site which describes our spot checking process/results. There were a few patients which didn't import, possible due to incorrect postcodes. As discussed over email, we are happy for you to provide the details of these patients (as this is a small number) and we can enter these manually or inform the clinical team for them to register directly.

We also could not find any patients on the new platform under COX3P (Manchester local care organisation), despite there being ~20 CYP within the data we supplied.

I am still happy to proceed despite the above as all the data on the new platform is accurate, and as long as we have a list of 'failed imports' we can communicate this to teams.

This was a big task, thank you for completing this so accurately & quickly!

@pacharanero
Copy link
Member

This import of patient data into the live platform is now complete. Closing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@eatyourpeas eatyourpeas

@pacharanero pacharanero

@anchit-chandran anchit-chandran

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@eatyourpeas @pacharanero @ollyrice @anchit-chandran @nikyraja @AmaniKrayemRCPCH