Update Citation Model to include page_end field for each opinion

[flooie]

@mlissner

I propose we update the citation model to include an optional page_end field. This change would provide several benefits:
1. Filtering by Substantive Opinions: Users could filter out table citations or focus on opinions based on their length, enhancing usability.
2. Data Analysis: It could help identify gaps in the data. While this wouldn’t work in all cases, it could highlight discrepancies in certain situations.

Additionally, I believe we already have much of this data in the Harvard JSON, which we chose not to capture initially because the data was embedded in the page numbers. In hindsight, that decision seems like a missed opportunity.

[mlissner]

Seems fine to me, but let's prioritize carefully. When we do this, we should look for other issues with the database label and see which we want to include at the same time:

database

I don't know what you mean by "Table citations" though? Example?

[flooie]

I think these are sometimes referred to as table citations. Citations that appear by reference only and without the actual opinion.

[mlissner]

Got it, thanks for the photo!

So you said that an advantage of having the page length of each opinion is that we'd be able to identify table citations. I think adding the word count would accomplish this as well (see #4844). Similar idea. Worth doing both.

[flooie]

could even add a is_valid flag - because we now see revoked citations - or removed citations.

[mlissner]

What do you mean?

[flooie]

I came across a revoked citation.

[mlissner]

What does that mean?

[flooie]

This amazing gem -

Apparently they withdraw citations from the bound volumes which I verified is actually correct. I assume its in subsequent publications its removed. I wonder if the advance sheets include removed citations?

[mlissner]

I assume advanced sheets contain the most, and subsequent volumes might remove things here and there.

In any case, we can add this to our citator instead of the citation model.