Populate EZID maillog to OpenSearch

[jsjiang]

The /var/log/maillog contains success and failure messages for emails sent from the EC2 host. If it is possible we would like to see this log in OpenSearch which provides better visualizations.

Sample failures:

Oct 29 17:37:51 uc3-ezidui-stg01 postfix/smtpd[2222144]: B7C87100197D: client=localhost[127.0.0.1]
Oct 29 17:37:51 uc3-ezidui-stg01 postfix/cleanup[2222147]: B7C87100197D: message-id=<173024867173.1592762.17870376543734086124@uc3-ezidui-stg01.cdlib.org>
Oct 29 17:37:51 uc3-ezidui-stg01 postfix/smtpd[2222144]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
Oct 29 17:37:51 uc3-ezidui-stg01 postfix/qmgr[2528]: B7C87100197D: from=<[email protected]>, size=710, nrcpt=1 (queue active)
Oct 29 17:37:51 uc3-ezidui-stg01 postfix/smtp[2222148]: B7C87100197D: to=<[email protected]>, relay=email-smtp.us-west-2.amazonaws.com[54.185.234.152]:25, delay=0.24, delays=0.01/0.08/0.1/0.05, dsn=5.0.0, status=bounced (host email-smtp.us-west-2.amazonaws.com[54.185.234.152] said: 554 Message rejected: Email address is not verified. The following identities failed the check in region US-WEST-2: [email protected] (in reply to end of DATA command))
Oct 29 17:37:51 uc3-ezidui-stg01 postfix/cleanup[2222147]: F3ED510000E3: message-id=<[email protected]>
Oct 29 17:37:52 uc3-ezidui-stg01 postfix/bounce[2222149]: B7C87100197D: sender non-delivery notification: F3ED510000E3
Oct 29 17:37:52 uc3-ezidui-stg01 postfix/qmgr[2528]: F3ED510000E3: from=<>, size=2965, nrcpt=1 (queue active)
Oct 29 17:37:52 uc3-ezidui-stg01 postfix/qmgr[2528]: B7C87100197D: removed
Oct 29 17:37:52 uc3-ezidui-stg01 postfix/smtp[2222148]: F3ED510000E3: to=<[email protected]>, relay=email-smtp.us-west-2.amazonaws.com[54.185.234.152]:25, delay=0.12, delays=0/0/0.11/0, dsn=5.0.0, status=bounced (host email-smtp.us-west-2.amazonaws.com[54.185.234.152] said: 501 Invalid MAIL FROM address provided (in reply to MAIL FROM command))

Sample successful info:

Oct 31 10:58:56 uc3-ezidui-dev01 postfix/smtpd[2306966]: 80171100E04F: client=localhost[127.0.0.1]
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/trivial-rewrite[2306968]: using backwards-compatible default setting append_dot_mydomain=yes to rewrite "uc3-ezidui-dev01" to "uc3-ezidui-dev01.cdlib.org"
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/trivial-rewrite[2306968]: using backwards-compatible default setting append_dot_mydomain=yes to rewrite "uc3-ezidui-dev01" to "uc3-ezidui-dev01.cdlib.org"
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/cleanup[2306969]: 80171100E04F: message-id=<173039753650.2306695.6745074208042711631@uc3-ezidui-dev01.cdlib.org>
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/qmgr[2043]: 80171100E04F: from=<[email protected]>, size=783, nrcpt=1 (queue active)
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/smtpd[2306966]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
Oct 31 10:58:56 uc3-ezidui-dev01 postfix/smtp[2306970]: 80171100E04F: to=<[email protected]>, relay=email-smtp.us-west-2.amazonaws.com[54.185.234.152]:25, delay=0.28, delays=0.01/0.08/0.03/0.15, dsn=2.0.0, status=sent (250 Ok 01010192e3bb0190-688bb1b3-e8f9-408d-a531-6887458cbb39-000000)