Add model manager that automatically allocate models and prevents OOMs

Add model manager that automatically allocate models and prevents OOMs #38531