creco-inference

Unified inference code for SageMaker and Hugging Face endpoints

Deployment

• Inference code (this) should be placed in the model folder respectively,

SageMaker

model/
  code/
    (repo)  <-- The repo inference code as direct child (no sub-folder)
  vae
  unet
  ...

• Refer deployment.ipynb for creating endpoint.

Hugging Face

model/
  (repo)  <-- The repo inference code as direct child (no sub-folder)
  vae
  unet
  ...

• Refer doc to create endpoint.