I’m using load_data function of Python API to load my json file. Is this function capable of loading a very large json file(bigger than ram size) for training models?
How big is this JSON file? I can’t imagine you have more than 1GB of text really?
I don’t know. Maybe a couple of gigabytes. I was thinking about expanding my train dataset in the case of a low-quality result which didn’t happen. Thanks.