Releases: xros/jsonpyes
Fix bugs for Python 3.6
Add Python 3.x support
jsonpyes
now supports Python 2.7, 3.3, 3.4, 3.5, 3.6 now!
1.3.1
Releasing more RAM when caching lines from a big file
It's recommended to have big RAM and extend more SWAP room when processing big data.
For those people who want better speed
Sometimes the data people would process could be 10GB -- 1000GB, so if you didn't have a big RAM server or PC, you would need to extend your SWAP space for caching. Also good multi-cores CPUs would be preferred. 😸
⛵ Now let's go fishing 🎣 🐟
Improved algorithm and shown diagram
With a clear diagram, it explains well why this is 5 to 10 times faster than before
Most of data are processed in RAM and on multi-threads.
Release 1.2.23 Much faster
Thanks to all contributors to this project.
jsonpyes
now can import raw JSON files to ElasticSearch at a much more faster speed than before.
Try to use --thread 8
if you feel slow.
😀
Release 1.2.22
With full documents and features.
Try it using:
pip install jsonpyes
Notice:
- the _id of every doc is generated randomly by default. If you want to defined _id when importing,
jsonpyes
is not your choice. But you can still dive into it. Welcome your pull requests. Let's see 😃