Empty files list on `competition_list_files` with nextPageToken

[discort]

Background

related - #572

competition_list_files returns empty files list using nextPageToken

code to reproduce:
kaggle==1.7.4.5

from kaggle.api.kaggle_api_extended import KaggleApi

COMPETITION = "rsna-intracranial-aneurysm-detection"

def main():
    api = KaggleApi()
    api.authenticate()
    page_size = 200
    all_files = []
    token = None

    while True:
        resp = api.competition_list_files(
            COMPETITION,
            page_size=page_size,
            page_token=token
        )
        d = resp.to_dict()
        files = d.get("files") or []
        print(len(files))
        if not files:
            break  # Kaggle bug hits here on RSNA; stops after page 1
        all_files.extend(files)
        token = d.get("nextPageToken") or None
        if not token:
            break


if __name__ == "__main__":
    main()

output:

200
0

expected (details):

[discort]

tagging @stevemessick as author of pagination.

[shyngys-aitkazinov]

Same issue for me with this particular dataset

[morizin]

anybody found solution