SinceIdIterator should yield responses as they are fetched

[osamak]

I am trying to fetch the complete favorite list, using the following code:

response_pool = client.api.favorites.list.get.iterator.with_since_id(screen_name=USERNAME,
                                                                     count=200,
                                                                     _force=False)
async for response in response_pool:
    for status in response:
        print(status)

Using the previous code snippet, IdIterators (i.e. MaxIdIterator and SinceIdIterator) will not yield any status until all statuses fetched, which goes against the purpose of iteration.

I am not sure if I am missing something, but statuses should be allowed to be processed before the complete list is fetched, to maximize the benefit of iteration.

[odrling]

For SinceIdIterators the iterator makes several requests to fill gaps in the responses (for example when there is more than 200 tweets sent between 2 iterations) by using a MaxIdIterator. You can disable this behavior by setting the _fill_gaps parameter of the iterator to False. Maybe this should be the default value of this parameter?

Other iterators only make one request to twitter for each iteration so it should be alright for MaxIdIterator and CursorIterator.

[odrling]

Actually shouldn't you be using max_id for this request if you want to get all the favorites?