Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement a search endpoint using solr #17

Open
2 of 6 tasks
anitacaron opened this issue Nov 22, 2022 · 2 comments
Open
2 of 6 tasks

Implement a search endpoint using solr #17

anitacaron opened this issue Nov 22, 2022 · 2 comments
Assignees

Comments

@anitacaron
Copy link
Collaborator

anitacaron commented Nov 22, 2022

  • Add solr docker image to the docker-compose
  • Do a 2 SOLR tutorials like https://www.youtube.com/watch?v=v4GNOnvdgtY (didnt check this)
  • Use sssom CLI to turn mapping sets to JSON
  • Write some code to load JSON into SOLR core
  • Create endpoint to search any field
  • Create endpoint to search a range for confidence field
@anitacaron anitacaron self-assigned this Nov 22, 2022
@matentzn
Copy link
Collaborator

matentzn commented Nov 30, 2022

Here is some ancient code I wrote:

https://github.com/VirtualFlyBrain/vfb-pipeline-dumps/blob/master/scripts/obographs-solr.py

Something that's maybe irrelevant: https://github.com/VirtualFlyBrain/vfb-solr

Be very careful with this, don't just copy blindly: https://github.com/VirtualFlyBrain/Docker-VFB-SOLR/blob/master/loadOLS.sh

@anitacaron
Copy link
Collaborator Author

Use sssom CLI to turn mapping sets to JSON

This also needs a script to flat the data. The decision would be to add all mapping_set information to each of its mappings, but there are the same attributes' names in both levels. Discussing with Nico, he said that the policy (not official) is to prioritise the field at the mapping level. And only take the mapping_set field if it's not available in the mapping. However, this is still in discussion on a case by case.

The list of terms present in mapping set and mapping: TBD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants