Message Data Serialization [minor]

[ric-evans]

JSON objects/files will now be used during message I/0. This change will ease the transition to SkyDriver 2.0 (EWMS 1.0).

This change can be seen in the following sections:

skymap_scanner/skymap_scanner/server/start_scan.py

Lines 402 to 409 in 0d3aeb0

	await pub.send(
	{
	cfg.MsgKeyToClient.RECO_ALGO: reco_algo,
	cfg.MsgKeyToClient.PFRAME_PKL_B64: messages.Serialization.encode_pkl_b64(
	pframe
	),
	}
	)

skymap_scanner/skymap_scanner/client/reco_icetray.py

Lines 278 to 283 in 0d3aeb0

	with open(args.infile, "r") as f:
	msg = json.load(f)
	reco_algo = msg[cfg.MsgKeyToClient.RECO_ALGO]
	pframe = messages.Serialization.decode_pkl_b64(
	msg[cfg.MsgKeyToClient.PFRAME_PKL_B64]
	)

skymap_scanner/skymap_scanner/client/reco_icetray.py

Lines 180 to 189 in 0d3aeb0

	json.dump(
	{
	cfg.MsgKeyFromClient.RECO_PIXEL_VARIATION_PKL_B64: messages.Serialization.encode_pkl_b64(
	reco_pixel_variation
	),
	# can't trust the clocks running in containers, but we can trust the relative time
	cfg.MsgKeyFromClient.RUNTIME: time.time() - start_time,
	},
	f,
	)

skymap_scanner/skymap_scanner/server/start_scan.py

Lines 475 to 479 in 0d3aeb0

	async with from_clients_queue.open_sub() as sub: # re-open to avoid inactivity timeout (applicable for rabbitmq)
	async for msg in sub:
	reco_pixel_variation = messages.Serialization.decode_pkl_b64(
	msg[cfg.MsgKeyFromClient.RECO_PIXEL_VARIATION_PKL_B64]
	)

Testing

The test data format for the single-pixel tests is now unified, so no script is needed to pre-transform data--this follows general best practices for testing.