Search no longer working on production for documents created within UI

[bwbaker1]

Description

Search is no longer working for documents created within the user interface on production. The metadata fields for uploaded PDFs still works.
All the search capabilities seem to still be working on staging.

cc @wrynearson

[wrynearson]

@sunu would you have any time to help us diagnose this bug? I'm seeing various errors in the console:

[sunu]

@wrynearson Looks like the server is returning 503 errors. I'll need help from @leothomas or someone with MCP access to debug.

[leothomas]

I believe we have fixed the issue by re-indexing the ATBDs in OpenSearch using the /v2/atbds/rebuild-index endpoint.

ref

(Note: to do so we used an Authorization Token from the prod console, as the /v2/users/auth endpoint doesn't seem to work with 2FA).

It seems that the ATBDs should be automatically indexed upon publication - however this doesn't seem to have occurred in the case of the above documents since they were not appearing in the search results before re-indexing. This should be further investigated/debugged.

@wrynearson the errors that noticed in the console are related to a different endpoint (/v2/bootstrap) and are not occurring on my end - let me know if they continue to appear on your machine.

[leothomas]

kudos to @sunu

[bwbaker1]

Thanks @sunu @leothomas