Ballpark speed comparison vs alternatives

[NickCrews]

Hey there! Just discovered this software. I've used libpostal and usaddress before. The developer experience definitely looks better and more modern here, but I'm wondering if you have any ballpark estimate on how the speed performance varies between these options? I am doing bulk processing (~10 million addresses), so speed is moderately important. Thank you!

[davebulaval]

Hi there!

Thank you for your interest in Deepparse. Deepparse was designed to offer a more modern and better development experience than other solutions (e.g. an easy-to-use Docker image and API deployment).

We have empirically analyzed the performance of libpostal and Deepparse but not with usaddress. The details are available here.

If you like to test usaddress and add your results to our table, I would greatly appreciate a PR for this. You can find the script used for the speed tests here.

[NickCrews]

Thank you! that is just what I was looking for.

[davebulaval]

Do you plant to open a PR with usaddress results?

[NickCrews]

unfortunately, I don't think I will pursue this library, libpostal appears to be so much faster that I think I will have to stick with it's worse ergonomics. If you manage to get the performance more comparable, I would love to revisit deepparse! Really appreciate your work.

[davebulaval]

It is normal; Libpostal is written in C. But, if you do not need online processing, it should not bother you.

Transferring the library to Rust would be the only way to accelerate our processing. It is part of our plan, but not in the short term.