Skip to content

@history-lab History Lab

Change the repository type filter

All

    Repositories list

    29 repositories

    • pplc

      Public
      pandemic program link checker
      Python
      •
      MIT License
      •0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • mosaic-llm-db

      Public
      Database views and scripts that support the Mosaic LLM project
      Shell
      •0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • un-archives-db-schema

      Public
      Corpus-specific schema objects for UN Archives metadata and text
      0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • archiving-digital-records

      Public
      Course materials from the 2023 & 2024 Archiving Digital Records track of the Archives as Data Summer Institute.
      1•3•0•0•Updated Oct 30, 2024Oct 30, 2024

    • foiarchive-api

      Public
      REST API for Freedom of Information Archive (FOIArchive)
      Python
      •0•3•10•3•Updated Oct 26, 2024Oct 26, 2024

    • covid19-streamlit

      Public
      History Lab COVID-19 Archive Prototype
      Python
      •
      MIT License
      •0•0•0•0•Updated Oct 25, 2024Oct 25, 2024

    • foiarchive-search

      Public
      Streamlit for FOIArchive search GUI
      Python
      •
      MIT License
      •1•2•0•0•Updated Oct 24, 2024Oct 24, 2024

    • topic-model-updates

      Public
      Scripts for updating corpus-specific topic models in the FOIArchive database.
      Shell
      •
      MIT License
      •0•0•0•0•Updated Oct 21, 2024Oct 21, 2024

    • foiarchive2csv

      Public
      SQL scripts for dumping FOIArchive data to CSV
      0•0•0•0•Updated Sep 27, 2024Sep 27, 2024

    • foiarchive-postgres

      Public
      Scripts, configuration and examples for the PostgREST proof of concept
      PLpgSQL
      •0•1•0•0•Updated Sep 18, 2024Sep 18, 2024

    • foiarchive2json

      Public
      Utility that takes a FOIArchive database SQL query as input and produces the result set in a JSON file.
      Python
      •0•0•0•0•Updated Sep 4, 2024Sep 4, 2024

    • HL-Spring-24

      Public
      Jupyter Notebook
      •1•0•0•0•Updated May 20, 2024May 20, 2024

    • foiarchive-api-python-example

      Public
      Example of querying the FOIArchive REST API via a Python program
      Jupyter Notebook
      •
      MIT License
      •0•0•0•0•Updated Feb 27, 2024Feb 27, 2024

    • HL-Fall-23

      Public
      Research project investigating OCR evaluation mechanisms at Columbia's History Lab.
      Python
      •1•0•0•0•Updated Feb 13, 2024Feb 13, 2024

    • foiarchive-pdfloader

      Public
      Downloads PDFs and stores the text in the FOIArchive database and a copy in an s3 bucket
      Python
      •
      MIT License
      •0•0•0•0•Updated Jan 28, 2024Jan 28, 2024

    • covid19-muckrock

      Public
      Scripts for preprocessing and loading of metadata and text for the History Lab-Muckrock COVID-19 Collection
      Python
      •
      MIT License
      •0•0•0•0•Updated Oct 16, 2023Oct 16, 2023

    • piir-eval

      Public
      Framework for PII redaction evaluation
      PLpgSQL
      •0•1•0•0•Updated Apr 28, 2023Apr 28, 2023

    • piir-gui

      Public
      Streamlit web GUI for PII redaction POC
      Python
      •
      MIT License
      •0•1•0•0•Updated Nov 23, 2022Nov 23, 2022

    • foiarchive-langdetect

      Public
      Script for determining the primary language of a document in a FOIArchive collection
      Python
      •
      MIT License
      •0•0•0•0•Updated Jun 29, 2022Jun 29, 2022

    • foiarchive-datefinder

      Public
      Finds dates in the first N characters of a FOIArchive doc. Useful for finding or confirming a document date.
      Python
      •
      MIT License
      •0•0•0•0•Updated Jun 29, 2022Jun 29, 2022

    • historylab-parser

      Public
      Java
      •1•0•1•5•Updated Jun 21, 2022Jun 21, 2022

    • oaiharvester

      Public
      Harvests archive metadata via OAI-PMH API.
      Python
      •
      MIT License
      •0•0•0•0•Updated May 3, 2022May 3, 2022

    • pdf2mbox-streamlit

      Public
      Streamlit interface to pdf2mbox
      Python
      •
      MIT License
      •0•0•0•0•Updated Mar 22, 2022Mar 22, 2022

    • xmpdf

      Public
      A Python module for extracting emails from a PDF.
      Python
      •
      MIT License
      •0•2•0•0•Updated Mar 22, 2022Mar 22, 2022

    • pdf2mbox

      Public
      a command-line utility and Python package for converting PDF emails to MBOX format
      pdfconverterarchivembox-files
      Python
      •
      MIT License
      •0•5•0•0•Updated Mar 22, 2022Mar 22, 2022

    • topic_models_using_rosetta

      Public
      Jupyter Notebook
      •1•0•0•0•Updated Aug 22, 2019Aug 22, 2019

    • cabinet

      Public
      1•1•0•0•Updated Apr 3, 2018Apr 3, 2018

    • history-lab-bookworm

      Public
      0•0•0•0•Updated Jul 21, 2017Jul 21, 2017

    • state_names

      Public
      Scraper for state department consular names and positions
      Python
      •0•0•0•0•Updated Apr 28, 2014Apr 28, 2014