Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Project types #543

Merged
merged 131 commits into from
Dec 28, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
131 commits
Select commit Hold shift + click to select a range
ab96222
Update 1501-increasing-debt-repayment.md
amandagirard Dec 28, 2023
38ada37
Update 1502-servicemember-roth-tsp-re-enrollment.md
amandagirard Dec 28, 2023
4160e58
Update 1503-increasing-idr-applications.md
amandagirard Dec 28, 2023
8ccf4c6
Update 1504-health-insurance-enrollment-2.md
amandagirard Dec 28, 2023
e5740c3
Update 1505-duplex-printing.md
amandagirard Dec 28, 2023
817094f
Update 1506-on-base-tsp-enrollment.md
amandagirard Dec 28, 2023
c9588c2
Update 1507-online-roth-tsp-enrollment.md
amandagirard Dec 28, 2023
f5c17f0
Update 1508-microloans-for-farmers.md
amandagirard Dec 28, 2023
99c8761
Update 1509-securities-account-transfers.md
amandagirard Dec 28, 2023
4969edb
Update 1510-reducing-inappropriate-prescribing.md
amandagirard Dec 28, 2023
88d116b
Update 1511-chapter-36-benefits.md
amandagirard Dec 28, 2023
99a350f
Update 1512_1-tenant-satisfaction-survey-calendar-invite.md
amandagirard Dec 28, 2023
5e58179
Update 1512_2-tenant-satisfaction-survey-subject-lines.md
amandagirard Dec 28, 2023
1b1b37f
Update 1512_3-tenant-satisfaction-survey-time-of-day.md
amandagirard Dec 28, 2023
f0c6e1d
Update 1513-grace-period-student-borrowers.md
amandagirard Dec 28, 2023
4cb07d5
Update 1514-2-iff-confirmation-prompt-update.md
amandagirard Dec 28, 2023
e95ff88
Update 1514-iff-reporting-errors.md
amandagirard Dec 28, 2023
72fd9d7
Update 1515-reducing-summer-melt.md
amandagirard Dec 28, 2023
2c8f10e
Update 15xx-di-denial.md
amandagirard Dec 28, 2023
17ed03a
Update 15xx-medicare-flu-vaccine-uptake.md
amandagirard Dec 28, 2023
274b593
Update 15xx-di-denial.md
amandagirard Dec 28, 2023
f9faa3e
Update 15xx-spouse-to-own.md
amandagirard Dec 28, 2023
c476925
Update 1601-mypay-reactivation.md
amandagirard Dec 28, 2023
74019aa
Update 1602-pslf-benefits-access.md
amandagirard Dec 28, 2023
cd2af3a
Update 1603_1-idr-applications-targeted-messages.md
amandagirard Dec 28, 2023
911540f
Update 1603_2-idr-applications-scale-up.md
amandagirard Dec 28, 2023
7d3eafe
Update 1603_2-idr-applications-scale-up.md
amandagirard Dec 28, 2023
fa4f168
Update 1604-idr-re-certification.md
amandagirard Dec 28, 2023
316df17
Update 1605-loan-rehab-rates.md
amandagirard Dec 28, 2023
789e486
Update 1607-patient-health-it.md
amandagirard Dec 28, 2023
5b0bb5c
Update 1608-medicare-patients-aco.md
amandagirard Dec 28, 2023
c421340
Update 1609-health-insurance-enrollment-1.md
amandagirard Dec 28, 2023
491b0ac
Update 1610-eitc-filing.md
amandagirard Dec 28, 2023
fc4d3d0
Update 1612-2-nslp-rolling-verification.md
amandagirard Dec 28, 2023
337f423
Update 1612-nslp-income-verification.md
amandagirard Dec 28, 2023
7a640c6
Update 1613-usda-local-elections.md
amandagirard Dec 28, 2023
c0cde9b
Update 1614-learning-center-enrollment.md
amandagirard Dec 28, 2023
de73003
Update 1615-hud-youth-fafsa.md
amandagirard Dec 28, 2023
31c055a
Update 1616-military-caregivers.md
amandagirard Dec 28, 2023
741d524
Update 1617-onesource-subcription.md
amandagirard Dec 28, 2023
5652c91
Update 1618-active-choice-tsp.md
amandagirard Dec 28, 2023
ec74736
Update 1620-1-military-patient-secure-messaging.md
amandagirard Dec 28, 2023
20adc62
Update 1620-2-military-patient-secure-messaging.md
amandagirard Dec 28, 2023
aa3dc9c
Update 16xx-tsp-enrollment-anchoring.md
amandagirard Dec 28, 2023
0ed1398
Update 1701-microloans-women-owned-farms.md
amandagirard Dec 28, 2023
e8ea639
Update 1702-Project-Management.md
amandagirard Dec 28, 2023
521b956
Update 1703-prompting-tsp.md
amandagirard Dec 28, 2023
332c375
Update 1704-USAJOBS-Demographics.md
amandagirard Dec 28, 2023
d128f37
Update 1705-Oregon-UI.md
amandagirard Dec 28, 2023
2e843d6
Update 1706-Encouraging-Action-Among-Students-At-Risk-to-Withdraw.md
amandagirard Dec 28, 2023
ecadae2
Update 1709-quetiapine-prescribing.md
amandagirard Dec 28, 2023
9c0579e
Update 1710-increasing-pre-and-post-natal-care.md
amandagirard Dec 28, 2023
9fc1aa5
Update 1711-health-insurance-uninsured-irs.md
amandagirard Dec 28, 2023
edff371
Update 1713-improving-homeless-liaison-support-homeless-students.md
amandagirard Dec 28, 2023
2e4d615
Update 1715-preventing-malaria-during-pregnancy.md
amandagirard Dec 28, 2023
f2ac0fe
Update 1716-Increasing-Student-FAFSA-Renewal-Rates.md
amandagirard Dec 28, 2023
9bc7f51
Update 1717-Increasing-FAFSA-Completion-NYCHA.md
amandagirard Dec 28, 2023
2e3c3fc
Update 1717-Increasing-FAFSA-Completion-Seattle-and-King-County.md
amandagirard Dec 28, 2023
3bcda23
Update 1722-increasing-art-adherence.md
amandagirard Dec 28, 2023
f30a072
Update 1723-increasing-ssi-uptake.md
amandagirard Dec 28, 2023
4405f53
Update 1724-increasing-tsp-enrollment.md
amandagirard Dec 28, 2023
880989e
Update 1725-concurrent-prescriptions.md
amandagirard Dec 28, 2023
a437625
Update 1726-Increasing-AHS-response-rates.md
amandagirard Dec 28, 2023
921dcb9
Update 1727-va-health-benefits.md
amandagirard Dec 28, 2023
72924c5
Update 1729-1-patient-health-data-provider-encouragement.md
amandagirard Dec 28, 2023
f0daf1d
Update 1729-2-patient-health-data-patient-reminders.md
amandagirard Dec 28, 2023
6fdddb7
Update 1732-soar.md
amandagirard Dec 28, 2023
bdfd920
Update 1732-soar.md
amandagirard Dec 28, 2023
e5fee35
Update 1732-soar.md
amandagirard Dec 28, 2023
33426d1
Update 2105-sb-counterfactual-equity.md
amandagirard Dec 28, 2023
c4d7ccb
Update 2008-dallas-small-business.md
amandagirard Dec 28, 2023
ae49ed8
Update 2003-san-diego-small-business-relief.md
amandagirard Dec 28, 2023
02a4d45
Update 2107-describing-candidate-assessments.md
amandagirard Dec 28, 2023
4cb6e34
Update 2206-HAF-Pilot.md
amandagirard Dec 28, 2023
6cc3388
Update 22XX-NOAA-Sea-Grant.md
amandagirard Dec 28, 2023
55dded8
Update 2100-noaa-equity.md
amandagirard Dec 28, 2023
450dda1
Update 2103-HEERF-evaluation-design.md
amandagirard Dec 28, 2023
475994a
Update 2113a-era.md
amandagirard Dec 28, 2023
f851928
Update 2113a-era.md
amandagirard Dec 28, 2023
eac13fe
Update 2006-sba-grant-equity.md
amandagirard Dec 28, 2023
3b454d6
Update XXXX-SSI-Wage-Reporting.md
amandagirard Dec 28, 2023
7742db0
Update 2310-decreasing-snap-denial-rates.md
amandagirard Dec 28, 2023
e240cff
Update 2309-decreasing-abandonment-of-calls-to-988.md
amandagirard Dec 28, 2023
0dc1aba
Update 2305-era-grantee-flexibilities-ky.md
amandagirard Dec 28, 2023
4074e98
Update 2302-ARP-ACA.md
amandagirard Dec 28, 2023
7c62ae1
Update 2301-era-grantee-flexibilities.md
amandagirard Dec 28, 2023
0620254
Update 2209B-increasing-access-to-childcare-grants.md
amandagirard Dec 28, 2023
5866516
Update 2209A-transparent-defaults-opt-out-texts.md
amandagirard Dec 28, 2023
bc66f17
Update 2205-ssi-health-effects.md
amandagirard Dec 28, 2023
4c24d51
Update 2202-rrr-ecip-descriptive-evaluation.md
amandagirard Dec 28, 2023
43d4b77
Update 2201-ED-R2T4.md
amandagirard Dec 28, 2023
aec11a6
Update 2121-increasing-naturalization.md
amandagirard Dec 28, 2023
53435b8
Update 2118-digital-forms.md
amandagirard Dec 28, 2023
5af6758
Update 2113B-ERA-equity.md
amandagirard Dec 28, 2023
5253694
Update 2113A-ERA.md
amandagirard Dec 28, 2023
d97b77f
Update 2112G-SLFRF.md
amandagirard Dec 28, 2023
be90c25
Update 2112F-SLFRF.md
amandagirard Dec 28, 2023
4755209
Update 2112E-SLFRF.md
amandagirard Dec 28, 2023
c7d9540
Update 2112D-SLFRF.md
amandagirard Dec 28, 2023
2791b9f
Update 2107-describing-candidate-assessments.md
amandagirard Dec 28, 2023
036ecd4
Update 2106-sba-equity-documentation.md
amandagirard Dec 28, 2023
09f002d
Update 2101-gsa-policymakers.md
amandagirard Dec 28, 2023
a9b9edd
Update 2101-D-transparent-defaults.md
amandagirard Dec 28, 2023
2402456
Update 2008-dallas-small-business.md
amandagirard Dec 28, 2023
d988d58
Update 2007-client-return-preparer.md
amandagirard Dec 28, 2023
2692196
Update 2004-return-preparer.md
amandagirard Dec 28, 2023
f9efd68
Update 2003-san-diego-small-business-relief.md
amandagirard Dec 28, 2023
26893cb
Update 2002-3-retrospective-analysis.md
amandagirard Dec 28, 2023
bf9f5f3
Update 19xx-congregate-meals.md
amandagirard Dec 28, 2023
d5c96ee
Update 1904-increasing-vaccines-performance-feedback.md
amandagirard Dec 28, 2023
20e6fde
Update 1903-wildfire-risk-assessments.md
amandagirard Dec 28, 2023
c5b4456
Update 1902-ssa-ticket-to-work.md
amandagirard Dec 28, 2023
838b89e
Update 1901-ahs-incentives-evaluation.md
amandagirard Dec 28, 2023
935997a
Update 1811-sms-mozambique.md
amandagirard Dec 28, 2023
2e56cc7
Update 1810-gi-bill-proactive-communication.md
amandagirard Dec 28, 2023
65e21fd
Update 1809-increasing-attendance-seattle.md
amandagirard Dec 28, 2023
af99cc4
Update 1808-energy-use-feedback.md
amandagirard Dec 28, 2023
cec3802
Update 1805-aotc.md
amandagirard Dec 28, 2023
4bc5044
Update 1804-va-opioid-buyback.md
amandagirard Dec 28, 2023
b960265
Update 1803-increasing-adult-vaccines-atlanta-va.md
amandagirard Dec 28, 2023
af1d249
Update 1801-USAGov-survey.md
amandagirard Dec 28, 2023
52f7a18
Update 17xx-msi-aligning-healthcare-services-nigeria.md
amandagirard Dec 28, 2023
5ff1ab2
Update 1743-flu-shots-va-new-york-harbor.md
amandagirard Dec 28, 2023
a4de25a
Update 1742-decreasing-energy-costs.md
amandagirard Dec 28, 2023
f9ac16f
Update 1740-flu-shots-va-st-cloud.md
amandagirard Dec 28, 2023
62b834d
Update 1739-gsa-auctions.md
amandagirard Dec 28, 2023
3ca10d9
Update 1738-increasing-vaccine-uptake-among-seniors.md
amandagirard Dec 28, 2023
146702d
Update 1737-vaccine-report-cards.md
amandagirard Dec 28, 2023
20912aa
Update 1736-pregnancy-vaccines-ads.md
amandagirard Dec 28, 2023
47aa332
Update 1735-duke-maternal-flu-shots.md
amandagirard Dec 28, 2023
6a4c630
Update 1733-increasing-fsa-among-government-employees.md
amandagirard Dec 28, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion _collaborations/2006-sba-grant-equity.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Increasing access to small business grant and loan programs for historically underserved groups
permalink: /collaborations/sba-grant-equity/
tags:
- project
- collaborations
- business
- covid
project_tags:
Expand Down
4 changes: 2 additions & 2 deletions _collaborations/2113a-era.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
title: Evaluation design for the Emergency Rental Assistance program
title: Evaluation design for the Emergency Rental Assistance program
permalink: /collaborations/emergency-rental-assistance/
tags:
- arp
Expand All @@ -8,7 +8,7 @@ image: /assets/img/project-images/othercollabs/2113A-ERA.webp
image_alt_text: Front of building on a street
image-credit: https://www.flickr.com/photos/hudopa/15358355891
year: 2021
type: Evaluation Design
type: Evaluation design
domain:
- American Rescue Plan
- Economic Opportunity
Expand Down
4 changes: 2 additions & 2 deletions _collaborations/22XX-NOAA-Sea-Grant.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ visualization: /assets/files/Knauss-Fellowship-process-map-long.pdf
year: 2022
domain:
agency: Commerce
summary: Administrative data and survey responses describe program challenges and opportunities to improve access and equity.
summary: Administrative data and survey responses describe program challenges and opportunities to improve access and equity
featured:
---

Expand All @@ -34,4 +34,4 @@ We also collaborated with Sea Grant to learn more about the experience of indivi

**Assessing program barriers is difficult because there were few respondents to the survey who did not apply to the fellowship program.** The survey identified what several applicants and Fellows experienced as aspects of the program that were more or less difficult to navigate. However, very few non-applicants responded to the survey, limiting the ability to draw conclusions about what may have prevented some potential applicants from applying.

*This project did not have an Analysis Plan*
This project did not have an Analysis Plan.
4 changes: 2 additions & 2 deletions _projects/1501-increasing-debt-repayment.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ image_alt_text: Treasury building front view
image-credit: https://www.flickr.com/photos/kevlar/
abstract: /assets/abstracts/1501-Delinquent-Debt-Repayment.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: Treasury
Expand All @@ -19,7 +19,7 @@ The Department of the Treasury’s Debt Management Services (DMS) was seeking to

## What was the program change?

OES modified the DMS collection letter using insights such as simplification, personalization, social comparison, and emphasizing the total debt owed, to increase the rate of debt recovery.
We modified the DMS collection letter using insights such as simplification, personalization, social comparison, and emphasizing the total debt owed, to increase the rate of debt recovery.

## How did the evaluation work?

Expand Down
2 changes: 1 addition & 1 deletion _projects/1502-servicemember-roth-tsp-re-enrollment.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image_alt_text: Service member re-enrollment
image-credit: https://www.flickr.com/photos/usaghumphreys
abstract: /assets/abstracts/1502-Servicemember-Roth-TSP-Re-Enrollment.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Retirement Security
agency: Defense
Expand Down
2 changes: 1 addition & 1 deletion _projects/1503-increasing-idr-applications.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ image-credit: https://www.flickr.com/photos/timetrax/
abstract: /assets/abstracts/1503-Income-Driven-Repayment.pdf
year: 2015
status: Complete
type: Program Change and Evaluation
type: Impact evaluation of program change
domain: Education
agency: Education
summary: Sending emails to delinquent borrowers positively impacted IDR application completion
Expand Down
2 changes: 1 addition & 1 deletion _projects/1504-health-insurance-enrollment-2.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ abstract: /assets/abstracts/1504-Federal-Health-Insurance-Marketplace-Enrollment
intervention: /assets/interventions/1504-FHIM-intervention-pack.pdf
academic-pub: /assets/publications/1504-yokum_2022_oi_220002_1646173226.27872.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Health
agency: Health and Human Services
Expand Down
2 changes: 1 addition & 1 deletion _projects/1505-duplex-printing.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ image_alt_text: Duplex printing
image-credit: https://www.flickr.com/photos/featheredtar/
abstract: /assets/abstracts/1505-Double-Sided-Printing.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: Agriculture
Expand Down
2 changes: 1 addition & 1 deletion _projects/1506-on-base-tsp-enrollment.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ image_alt_text: Man sitting at desk wearing navy uniform
image-credit: https://www.flickr.com/photos/usnavy/
abstract: /assets/abstracts/1506-On-Base-Servicemember-TSP-Enrollment.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Retirement Security
agency: Defense
Expand Down
2 changes: 1 addition & 1 deletion _projects/1507-online-roth-tsp-enrollment.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ image: /assets/img/project-images/roth-tsp-enrollment.webp
image_alt_text: Roth TSP enrollment
abstract: /assets/abstracts/1507-Servicemember-TSP-Enrollment.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Retirement Security
agency: Defense
Expand Down
2 changes: 1 addition & 1 deletion _projects/1508-microloans-for-farmers.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ image-credit: https://www.flickr.com/photos/usdagov
abstract: /assets/abstracts/1508-Microloans-for-Farmers.pdf
academic-pub: /assets/publications/1508-publication-bowers-higgins-replication-2017.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Economic Opportunity
agency: Agriculture
Expand Down
2 changes: 1 addition & 1 deletion _projects/1509-securities-account-transfers.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ image_alt_text: Treasury building front
image-credit: https://www.flickr.com/photos/71380981@N06/
abstract: /assets/abstracts/1509-Legacy-Treasury-Direct-Accounts.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: Treasury
Expand Down
12 changes: 4 additions & 8 deletions _projects/1510-reducing-inappropriate-prescribing.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
title: Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D
title: Reducing inappropriate prescribing of Schedule II substances in Medicare Part D
permalink: /projects/reducing-inappropriate-prescribing/
tags:
- project
Expand All @@ -11,29 +11,25 @@ abstract: /assets/abstracts/1510-Prescriber-Letters.pdf
academic-pub: /assets/publications/1510-medicare-letters-to-curb-overprescribing.pdf
intervention: /assets/interventions/2002-CMS-intervention-pack.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Health
agency: Health and Human Services
summary: Sending letters to potential overprescribers did not influence Schedule II prescribing activities.
---
## What was the challenge?

Inappropriate prescribing can threaten patient health and increase healthcare costs. A body of research shows evidence of some providers overprescribing certain pharmaceuticals, including Schedule II drugs (e.g., opioids). Through its Center for Program Integrity (CPI), the Centers for Medicare and Medicaid Services (CMS) uses a variety of approaches to combat overprescribing.

## What was the program change?

Studies have shown that letters, especially those highlighting social comparisons, can motivate individuals to more carefully examine their own behavior. OES developed letters designed to educate providers and induce them to “self-audit” to correct potentially improper prescriptions.
Studies have shown that letters, especially those highlighting social comparisons, can motivate individuals to more carefully examine their own behavior. We developed letters designed to educate providers and induce them to “self-audit” to correct potentially improper prescriptions.

## How did the evaluation work?

CMS identified potential improper prescribers (those who prescribed far more than their peers in the same state and medical specialty.) 1,518 providers were randomly assigned to be sent a letter, or not.

## What was the impact?

Using data collected over the 90 days after the letter was mailed, comparisons failed to detect an effect of the letter on Schedule II prescribing.

<i> Related Publications</i>
<i> Related publications</i>
<br>
Adam Sacarny, David Yokum, Amy Finkelstein, and Shantanu Agrawal. <a href="https://www.healthaffairs.org/doi/10.1377/hlthaff.2015.1025">Medicare letters to curb overprescribing of controlled substances had no detectable effect on providers.</a> Health Affairs 35 no. 3 (2017): 471-479.
<br>
Expand Down
14 changes: 5 additions & 9 deletions _projects/1511-chapter-36-benefits.md
Original file line number Diff line number Diff line change
@@ -1,30 +1,26 @@
---
title: Increasing Chapter 36 Benefits Uptake by Veterans
title: Increasing Chapter 36 benefits uptake by Veterans
permalink: /projects/chapter-36-benefits/
tags: project
image: /assets/img/project-images/ch36.webp
image_alt_text: People talking
image-credit: https://www.flickr.com/photos/usnavy/
abstract: /assets/abstracts/1511-Chapter 36-Benefits-for Veterans.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Economic Opportunity
agency: Veterans Affairs
summary: Emails informing veterans about education and career benefits increased applications.
summary: Emails informing veterans about education and career benefits increased applications
---
## What was the challenge?

The Department of Veterans’ Affairs (VA) is committed to helping military Servicemembers fully reintegrate back into society through Chapter 36 services which include personalized counseling on education, career options, and accessing related VA benefits. The Chapter 36 application process is paper-based and involves multiple steps, which may create barriers to access.
The Department of Veterans’ Affairs (VA) is committed to helping military Servicemembers fully reintegrate back into society through Chapter 36 services which include personalized counseling on education, career options, and accessing related VA benefits. The Chapter 36 application process is paper-based and involves multiple steps, which may create barriers to access.

## What was the program change?

OES identified email as a low cost tool to inform Veterans about Chapter 36 benefits, their eligibility, the application process, and what to expect after an application was submitted. OES developed an email using social science insights, such as emphasizing that Veterans earned these benefits through their service.
We identified email as a low cost tool to inform Veterans about Chapter 36 benefits, their eligibility, the application process, and what to expect after an application was submitted. OES developed an email using social science insights, such as emphasizing that Veterans earned these benefits through their service.

## How did the evaluation work?

64,270 eligible Veterans with a valid email address on record were randomly assigned to receive one of three options: 1) business as usual (sent no email from the VA about the benefit), 2) basic email notifying the Veteran of the benefit, or 3) an email emphasizing that the Veteran earned the benefit.

## What was the impact?

Both emails increased applications and completion of services, but overall uptake rates remained low. The email emphasizing that the Veteran earned the benefit outperformed the basic email on open and click- through rates.These results suggest that email can be an inexpensive and effective way to share information about Chapter 36 benefits, but that they may not lead to substantial improvements in benefits utilization.
15 changes: 6 additions & 9 deletions _projects/1512_1-tenant-satisfaction-survey-calendar-invite.md
Original file line number Diff line number Diff line change
@@ -1,32 +1,29 @@
---
title: Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite
title: Increasing satisfaction survey response rate from federal tenants - calendar invite
permalink: /projects/tenant-satisfaction-survey-calendar-invite/
tags: project
image: /assets/img/project-images/gsa-tenant1.webp
image_alt_text: Front of building
image-credit: https://www.gsa.gov/portal/content/163627
abstract: /assets/abstracts/1512-1-Tenant-Satisfaction-Survey-Response-Calendar-Invite.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: General Services Administration
summary: Emails including a calendar invite reminder led to increased survey responses from Federal employees.
summary: Emails including a calendar invite reminder led to increased survey responses from federal employees
---
## What was the challenge?

## What was the challenge?
GSA’s Public Buildings Service (PBS) owns or leases over 9,600 assets, with more than 370M square feet of space for over one million federal employees. Each year, PBS sends Federal employees the Tenant Satisfaction Survey (TSS), the results of which inform the Federal facilities strategy.

## What was the program change?

Small details, like framing of an email, can matter more than might be expected. Varying delivery methods (e.g., a calendar-based reminder) of workplace email requests can affect email open and click-through rates. OES created a calendar reminder feature for the TSS to see if it resulted in higher open and click-through rates.
Small details, such as the framing of an email, can matter more than might be expected. Varying delivery methods (e.g., a calendar-based reminder) of workplace email requests can affect email open and click-through rates. We created a calendar reminder feature for the TSS to see if it resulted in higher open and click-through rates.

## How did the evaluation work?

29,997 employees were randomly assigned to receive one of two emails: 14,997 received the business as usual launch email, and 15,000 received an email with an embedded calendar invite to use as a reminder to take the survey. The two emails had distinct links to two identical versions of the survey, allowing tracking of views, starts, and completions by email group.

![image]({{site.baseurl}}/assets/img/project-images/1512-1-graph.webp)

## What was the impact?

One week after sending the emails, the calendar reminder resulted in a nearly one percentage point higher completion rate amongst people sent the email, and a 13.5% higher relative completion rate.
One week after sending the emails, the calendar reminder resulted in a nearly 1 percentage point higher completion rate amongst people sent the email, and a 13.5% higher relative completion rate.
12 changes: 4 additions & 8 deletions _projects/1512_2-tenant-satisfaction-survey-subject-lines.md
Original file line number Diff line number Diff line change
@@ -1,30 +1,26 @@
---
title: Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week
title: Increasing satisfaction survey response rate from federal renants - subject lines and day of week
permalink: /projects/tenant-satisfaction-survey-subject-lines/
tags: project
image: /assets/img/project-images/gsa-tenant2.webp
image_alt_text: Front of building
image-credit: https://gsablogs.gsa.gov/gsablog/2012/11/08/gsa-completes-restoration-of-hipolito-federal-building/
abstract: /assets/abstracts/1512-2-Tenant-Satisfaction-Survey-Response-Subject-Lines-and-Day-of-Week.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: General Services Administration
summary: Emails with subject lines that included the word "please" increased Federal employees responses to a workplace survey.
summary: Emails with subject lines that included the word "please" increased federal employees responses to a workplace survey
---
## What was the challenge?

GSA’s Public Buildings Service (PBS) owns or leases over 9,600 assets, with more than 370 million square feet of space for over one million federal employees. Each year, PBS sends Federal employees the Tenant Satisfaction Survey (TSS), the results of which inform the Federal facilities strategy.

## What was the program change?

Small details, like the framing or timing of an email, can matter more than might be expected. Varying subject line wording (e.g., including “please”) of workplace email requests can affect email open and click-through rates. Using this research, OES redesigned and reconfigured the TSS to assess what subject lines, as well as what day of the week on which the email is sent, resulted in the highest open and click-through rates.
Small details, such as the framing or timing of an email, can matter more than might be expected. Varying subject line wording (e.g., including “please”) of workplace email requests can affect email open and click-through rates. Using this research, we redesigned and reconfigured the TSS to assess what subject lines, as well as what day of the week on which the email is sent, resulted in the highest open and click-through rates.

## How did the evaluation work?

An announcement email was sent to two randomly assigned groups of approximately 11,500 Federal employees three times a day for a week—at 9:00 a.m., 12:30 p.m., and 4:00 p.m., ET. In addition to time-of-day and day-of-week variation, aspects of the subject line were also varied (e.g., action statement, use of please, and use of exclamation point), testing paired permutations against each other.

## What was the impact?

Sending emails near lunchtime on Tuesdays and Wednesdays resulted in higher responses than other days and times. Also, results indicated that including “please” in subject lines increased response rates, while adding an exclamation point reduced response rates.
13 changes: 5 additions & 8 deletions _projects/1512_3-tenant-satisfaction-survey-time-of-day.md
Original file line number Diff line number Diff line change
@@ -1,32 +1,29 @@
---
title: Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day
title: Increasing satisfaction survey response rate from federal tenants - time of day
permalink: /projects/tenant-satisfaction-survey-time-of-day/
tags: project
image: /assets/img/project-images/tenant-statisfaction.webp
image_alt_text: Front of building
image-credit: https://commons.wikimedia.org/wiki/User:Aboutmovies
abstract: /assets/abstracts/1512-3-Tenant-Satisfaction-Survey-Response-Time-of-Day.pdf
year: 2015
type: Program Change and Evaluation
type: Impact evaluation of program change
status: Complete
domain: Government Operations
agency: General Services Administration
summary: Emails sent at lunchtime saw 1.5% more Federal employees click through to a workplace survey.
summary: Emails sent at lunchtime saw 1.5% more federal employees click through to a workplace survey
---
## What was the challenge?

## What was the challenge?
GSA’s Public Buildings Service (PBS) owns or leases over 9,600 assets, with more than 370 million square feet of space for over one million federal employees. Each year, PBS sends Federal employees the Tenant Satisfaction Survey (TSS), the results of which inform the Federal facilities strategy.

## What was the program change?

Small details, like the framing or timing of an email, can matter more than might be expected. Varying the time of workplace email requests can affect email open and click-through rates. Using this research, OES reconfigured the TSS "send out" to assess what time of day resulted in the highest open and click-through rates.
Small details, such as the framing or timing of an email, can matter more than might be expected. Varying the time of workplace email requests can affect email open and click-through rates. Using this research, we reconfigured the TSS "send out" to assess what time of day resulted in the highest open and click-through rates.

## How did the evaluation work?

Identical emails were sent to randomly selected groups of 96,000 federal employees (873,755 total intended recipients) every hour over the course of the day, starting at 8:55 a.m and ending at 1:55pm.

![image]({{site.baseurl}}/assets/img/project-images/1512-3-graph.webp)

## What was the impact?

Emails sent at 11:55 a.m. had an open rate that was 2.5 percentage points higher than the 8:55 a.m. send, and a click-through rate that was 1.5 percentage points higher. Sending emails three hours later meant that approximately 1,500 more people read and followed through on the email request.
Loading
Loading