add a pass through mode for large files

[msmeissn]

via an IRC reporter

huge files will cause huge memory usage, as the file is cached in meory.

Investigate how fuse does pass through file reading and implement that

[msmeissn]

I am adding gp_camera_file_read there

[pmnordkvist]

I do extensive backups on several different devices and have experience big problems with large files over gphotofs which forced me to use gphoto2 directly to copy files over a few hundred megabytes so this is very helpful.

One thing I have read in the past but can't seem to find is information on where gphotofs stores temporary files? Is that in TMPDIR? I run OS on a fast partition and copy to a slow one and would like to store temporary files on the remote partition if possible.

[msmeissn]

currently gphotofs stores it only in memory, without using temporary backing storage.

what i am adding currently is pass through, so it does not need to be stored in memory.

[michael-berlin]

I think this is fixed?

I've successfully used the current code from the master branch to copy large files (> 2GB) from an iPhone. That was on a Raspberry Pi with only 1 GB RAM. The Fuse process gphotofs never went over ~10 MB memory usage during that time.

[msmeissn]

reading is fixed, so yes

writing still uses in-memory state, have to do that still.

[robertalers]

When i take a picture with my Nikon d750 new files does nog automaticly show up in the mounted directory . Log states it should from 1.0 upward.
Is this a bug or is there something i’m doing wrong?

[msmeissn]

hmm, we are polling events so we should get notifications for new files and add them

[robertalers]

I use a RPI, could this cause the problem? Any actions I can take te debug this? Thank you for your response!