Upload limit

[mhkeller]

Is there a hardcoded upload size limit? I'm trying to upload a csv that's over 1gb and it says it fails for an unknown reason. Same thing happens if I upload the shapefile output of that file from QGIS. If I upload a subset it works fine.

[sverhoeven]

Yes, there is an upload limit of 150Mb at https://github.com/sverhoeven/docker-cartodb/blob/master/config/cartodb.nginx.proxy.conf#L4

[mhkeller]

Thanks. I pulled the latest to get 397ffca and started from scratch but I still get an unknown error on upload. I don't see any error doing docker logs <id>. Is there another place to look?

[sverhoeven]

The importing is handled by the resque worker.

It writes it log files to /cartodb/resque.log, which you can view with docker exec <container> cat /cartodb/resque.log.

[mhkeller]

Hmm, the logs don't show any activity. If I import a smaller shapefile or one of the stock datasets like chicago building footprints, I do see logs.

[mhkeller]

I put together a test repo to generate a csv containing a few million random points: https://github.com/mhkeller/gen-points

I get the same silent failing using the result from this script as I do with my file.

[mhkeller]

@sverhoeven any thoughts on this?

[sverhoeven]

No idea, I have not used Carto for a long time.