Uploading From Cloud Storage
There are three primary ways to provide video files to NomadicML:- Public URLs or Local Files: The simplest method for getting started. See the Quickstart guide for examples.
- Direct Cloud Integration: Grant our backend read-only access to your cloud storage bucket. This is the recommended approach for automated, continuous data ingestion.
- Signed URLs: Generate temporary, secure URLs for individual private files. This is ideal for one-off uploads from a secure environment.
Direct Cloud Integration
To avoid exchanging keys, we offer direct integration with your cloud storage. This approach is ideal for continuous data ingestion pipelines. We support secure, read-only access for the following providers:Cloud Provider | Integration Method | Details |
---|---|---|
AWS S3 | Bucket Policy | Grant our IAM role (arn:aws:iam::xxxx:role/xxxx-readonly-role ) read-only access to your S3 bucket |
Google Cloud Storage | IAM Policy | Grant the Storage Object Viewer role to our service account (xxxx@our.iam.gserviceaccount.com ) on your GCS bucket. |
Azure Blob Storage | Role Assignment | Please contact us to get the correct Service Principal for role assignment. |