MegaIssue: Cache improvements

[martinbonnin]

This is an generic issue to list ideas/improvements that can be done to the normalized cache

• Initial implementation of cache control #3566
• Improved pagination support #3807
• Implement a maxSize for the SQLite cache #4206 - currently in incubating
• ⏱️ Benchmark Cache CPU  #4028
• ⏱️ Benchark Cache size  #4027
• Debugging why an observed query is refetched #2397
• Allow normalization to be disabled for specific types #3827
• Skipping cache on a per-type basis apollo-kotlin-normalized-cache-incubating#84
• Fail-safe SQLite cache #2961
• Support manual cache eviction #3806
• CacheKeyResolver.fromFieldArguments should have access to the type information  #2496
• Implement a garbage collector to remove unreachable nodes #3805
• Remove any dangling references when removing records apollo-kotlin-normalized-cache-incubating#85
• Updating the cache using data classes is tedious #3573
• Add a mechanism to detect when an object has an id but we're not requesting it #1977
• Extend @typePolicy keyFields to accept non scalar types  #5203
• Provide an API to watch fragments  #4223
• handle subgraph/field expiration/timeouts #3709
• Pagination: merge nodes field in addition to edges #5735
• cache db was leaked apollo-kotlin-normalized-cache-incubating#66
• SQLite Cache Age and Eviction APIs apollo-kotlin-normalized-cache-incubating#75
• reponse time 5 times slower when normalizedCache is enabled apollo-kotlin-normalized-cache-incubating#76
• Add functionality to remove entries from cache in ApolloStore by Operation/Fragment apollo-kotlin-normalized-cache-incubating#77
• Fail fast if two ApolloStores use the same underlying database  #3564
• LruCache returns partial record for QUERY_ROOT resulting in cache lookup failure #2013
• Query watcher re-emitting old value after caches are cleared apollo-kotlin-normalized-cache-incubating#78
• ApolloStore with "remove(key, cascade)" does not delete any records apollo-kotlin-normalized-cache-incubating#79
• Implement a garbage collector to remove unreachable nodes #3805
• Make ApolloStore aware of the client CustomScalarAdapters #3823
• doNotStoreOnDisk() #5984
• ApolloStore#clearAll method does not trigger changes to watchers #2532
• Normalized Cache per Fragment #1990
• ⌨️ Programmatic per-type Cache Control apollo-kotlin-normalized-cache-incubating#37
• Key Field(s) '[id]' are not queried on XUnion at Operation(XQuery).union #5174
• SQLiteBlobTooBigException: Row too big to fit into CursorWindow #4072
• Declarative cache: allow specifying lists of key arguments  #4594
• Make cache easier to work with  #5317
• Add API to track cache write times #5525
• Cache key strict mode  #4687
• Declarative cache doesn't work with unions #5635
• ApolloStore#remove(keys) method does not accept "cascade" flag apollo-kotlin-normalized-cache-incubating#74

[ychescale9]

I assume this requires weigher API if you're still planning to use Dropbox/Store/cache? Are there any other features / API changes you'd like to see from cache to enable these improvements?

[martinbonnin]

@ychescale9 I think multiplatform is a big one. I don't think Store supports multiplatform yet?

Multiplatform would be required for the LruNormalizedCache to be used from apollo-runtime-kotlin

[ychescale9]

@martinbonnin multiplatform support for Store itself has been deprioritized. I’m keen to push for KMP support for the cache module first which currently is JVM only and does not depend on coroutines, so we can unblock apollo-android.

[martinbonnin]

That's be great! I think cache4 is all we need. I don't think we use store at the moment.

[ahetawal-p]

@martinbonnin Could this be also part of these improvements related to cache eviction:
https://github.com/apollographql/apollo-android/issues/2507