Optionally write out all of the parquet files.

[delucchi-cmu]

Change Description

This is part of astronomy-commons/hats#147 (in a kind of round-a-bout way).

This adds functionality to the pipeline to optionally write out all of the leaf parquet files necessary for the association table, mostly to generate a test association catalog for hipscat/lsdb. When leaf parquet files are written out, we use those footers to generate a _metadata file for the catalog. Otherwise, we artificially create the necessary metadata.

[codecov]

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (2a476a8) 99.91% compared to head (221bdd1) 99.76%.
Report is 1 commits behind head on main.

Files	Patch %	Lines
src/hipscat_import/soap/map_reduce.py	96.77%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #181      +/-   ##
==========================================
- Coverage   99.91%   99.76%   -0.16%     
==========================================
  Files          27       27              
  Lines        1164     1250      +86     
==========================================
+ Hits         1163     1247      +84     
- Misses          1        3       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[camposandro]

Other than that, it all seems to make sense to me!