foundry
Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.
What is foundry?
Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.